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Plenary  Session 

►  ►  ►  ►  Plenary  Session  <  <  <  < 

Tuesday  - 18  June  2002  -  0830  - 1000 


Keynote  Session  &  General  Membership  Meeting 
Bell  Hall,  Eisenhower  Auditorium 


•  Call  to  Order 

Dr.  Steven  E.  Pilnick,  Program  Chair,  70th  MORSS 

•  National  Anthem  &  Posting  of  Colors 

•  Host  Welcome 

Mr.  Michael  F.  Bauman,  Director,  TRADOC  Analysis  Center 

•  Sponsor’s  Welcome 

Mr.  Walter  W.  Hollis,  FS,  Deputy  Under  Secretary  of  the  Army,  Operations  Research 

•  Keynote  Address 

LTG  Benjamin  S.  Griffin,  Deputy  Chief  of  Staff,  G-8,  US  Army 

•  MORS  Welcome  and  2002  Membership  Meeting 

Dr.  Thomas  L.  Allen,  President 

•  Presentation  of  Awards  -  Dr.  Thomas  L.  Allen 

■  Investing  of  Fellows  of  the  Society  (Dr.  Jerry  A.  Kotchka,  Ms.  Mary  G.B.  Pace  &  Mr.  Vincent  P.  Roske,  Jr.) 

Dr.  Thomas  L.  Allen,  Lt  Col  Suzanne  M.  Beers,  and  Mr.  Dean  Free 

■  Vance  R.  Wanner  Award  (Mr.  Michael  F.  Bauman) 

Presented  by  Dr.  Thomas  L.  Allen  and  Dr.  Roy  E.  Rice 

■  Clayton  J.  Thomas  Award  (Dr.  Gregory  S.  Parnell,  FS) 

Presented  by  Dr.  Thomas  L.  Allen  and  Dr.  Roy  E.  Rice 

■  Richard  H.  Barchi  Prize  (Mr.  Branford  J.  McAllister) 

Presented  by  Dr.  Thomas  L.  Allen  and  Mr.  Denis  Clements 

■  Announcement  of  MOR  Journal  Award 

(Presented  at  5lh  Annual  MAS  Conference) 

•  State  of  the  Society  -  Dr.  Thomas  L.  Allen 

•  Recognition  of  Chairs  -  Dr.  Thomas  L.  Allen 

•  Administrative  Announcements  -  Mr.  Patrick  Smock 
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Special  Sessions 

►  ►  ►  ►  ►  Special  Session  I  ^  ^  ^  ^  ^ 

Tuesday  - 18  June  2002  - 1530-1700 


Special  Sessions  Coordinators:  Sue  Iwanski,  SPA,  Inc 

Bob  Clemence,  RAND 

Barchi  Prize  Paper  Session . GIF,  DuPuy  Auditorium 

Chair:  Denis  Clements,  GRCI 

MORS  will  recognize  and  present  the  Barchi  Prize  during  the  Plenary  Session.  The  Barchi  Prize  is  selected  annually  from 
among  the  papers  derived  from  each  working  group's  best  presentation.  Therefore,  the  Barchi  Prize  is  often  called  "the  Best  of  the 
Best."  The  author  will  brief  his  award-winning  accomplishments  during  this  Prize  Paper  Session. 

70th  MORSS  Barchi  Prize  Recipient:  Col  Branford  J.  McAllister,  USAF  (Ret.),  Sverdrup  Technology  Inc. 

F -15! AIM-120  AMRAAM  Weapons  Envelopes:  A  Unique  Application  of  Operations  Research 
During  Operational  Testing 

Air-to-air  combat  often  is  characterized  by  tradeoff  decisions  involving  lethality  and  survivability.  For  example,  the  choices  of 
radar  mode  and  shooter  maneuvers  that  are  best  for  the  success  of  a  missile  (lethality)  place  the  shooter  at  greater  risk  to  a 
successful  engagement  by  his  adversary  (survivability).  This  paper  documents  the  results  of  an  operational  test  and  evaluation 
(OT&E)  assessing  these  tradeoffs  using  operations  research  tools.  The  test  had  two  objectives:  (1)  assess  the  lethality  of  the  AIM- 
120  air-to-air  missile  and  the  validity  of  F- 15 -computed  envelopes  and  displays  as  a  function  of  radar  mode  and  shooter  post-launch 
maneuvers,  and  (2)  evaluate  the  effects  of  pot-launch  maneuvering  on  survivability  during  air-to-air  engagements.  There  were  three 
noteworthy  aspects  of  this  evaluation.  The  use  of  Design  of  Experiment  (DOE)  and  statistical  techniques  to  plan  the  test,  execute 
flight  missions  and  simulations,  and  analyze  results.  The  second  was  the  marriage  of  open-air  flight  test  and  simulation  models  to 
obtain  realistic  and  tactically  sound  test  data.  The  third  was  a  set  of  conclusions  and  recommendations  pertaining  to  the  tactical 
decisions  (tradeoffs)  regarding  radar  mode  and  shooter  maneuvers,  and  the  impact  of  those  decisions  on  engagement  success. 

Junior/Senior  Analyst  Session  1  . Bell  Hall,  Marshall  Auditorium 

Chair:  Jay  Wilmeth,  Northrop  Grumman  IT 

The  Junior/Senior  Analyst  program  will  take  place  for  the  thirteenth  consecutive  year  at  the  70th  MORS  Symposium  at  the  US 
Army  Combined  Arms  Center  at  Fort  Leavenworth,  Kansas.  Historically,  this  event  has  been  very  successful  and  has  drawn  both 
junior  and  mid-level  audiences.  MORS  offers  two  separate  sessions,  each  on  consecutive  days.  The  idea  is  to  accommodate  those 
who  enjoy  visiting  with  and  listening  to  leading  senior  analysts  known  to  most  of  us,  while  enabling  our  more  junior  analysts  to 
focus  on  their  concerns  with  mid-level,  well  established  MORSians  closely  aligned  with  the  analytical  community  of  today. 

The  first  session  is  scheduled  for  Tuesday  afternoon  in  an  auditorium  that  will  accommodate  a  relatively  large  number  of 
participants.  The  session  will  be  open  to  all  to  hear  distinguished  senior  analysts  discuss  topics  relating  to  this  year’s  theme  in 
particular  and  to  the  world  of  operations  research  in  general.  After  introductory  remarks  from  each  of  the  seniors,  the  balance  of  the 
period  will  feature  a  moderator-led  Q&A  session  from  the  floor.  This  session  was  enormously  successful  last  year  at  the  Naval 
Academy.  We  hope  to  duplicate  or  surpass  it  this  year. 

Mr.  Vincent  P.  Roske,  Jr.,  FS,  Joint  Staff,  J8  Dr.  Peter  Purdue,  Naval  Postgraduate  School 

Dr.  Alfred  Brandstein,  Marine  Corps  Warfighting  Lab  Dr.  Roy  E.  Rice,  Teledyne  Brown  Engineering 

Homeland  Security  Special  Session . Bell  Hall,  Eisenhower  Auditorium 

Chair:  LTC  George  F.  Stone  III,  USA,  OSD(PA&E) 

When  MORS  held  its  first  Homeland  Security  (HLS)  Mini-Symposium  in  March  of  2001,  HLS  interest  was  still  developing. 
During  the  mini-symposium,  the  papers  and  discussions  were  very  informative,  yet  the  “fire  and  brimstone”  effects  of  September 
1 1th  were  unheard  of.  Now  the  words  of  Thomas  Jefferson  ring  true:  “  It  is  our  duty  still  to  endeavor  to  avoid  war;  but  if  it  shall 
actually  take  place,  no  matter  by  whom  brought  on,  we  must  defend  ourselves.  If  our  house  be  on  fire...  we  must  try  to  extinguish 
it.” 

Suddenly  the  country  realizes  the  vulnerability  of  the  US  homeland.  The  HLS  vision  and  effort  are  now  a  main  concern  of  our 
populace  and  at  all  levels  of  government.  About  40  agencies  will  need  to  work  together  toward  a  common  goal.  Proponents  who 
sought  more  emphasis  on  asymmetric  warfare  and  HLS  were  included  in  the  2001  Quadrennial  Defense  Review:  “Mr.  Rumsfeld 
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Special  Sessions 

said  the  QDR  ‘fortuitously  ...  at  least  addressed  the  problems  of  homeland  defense  and  the  problems  of  asymmetrical  threats  rather 
well.’”  The  supporting  role  that  the  military  will  play  in  the  Office  of  Homeland  Security  is  becoming  a  high  priority  mission. 

The  HLS  office  and  supporting  agencies  will  need  analytical  support  for  decision  makers  to  prepare,  train,  equip  and  integrate 
personnel,  efforts  and  resources. 

If  you  are  thinking  about  volunteering  to  work  in  Homeland  Security,  you  are  not  alone: 

•  “...need  to  get  a  lot  smarter  about  this  HLS  missioning  (sic)  in  order  to  provide  proper  guidance  to  the  staff  when  we 
develop  OPORD/OPLAN.” 

•  “I  am  working  with  the  Navy  staff  (N70  CP)  on  homeland  security  issues.  I  am  trying  to  track  down  any  briefs, 
findings,  articles,  etc  that  came  from  this  area.” 

•  “How  do  I  apply?” 

•  “I  used  to  manage  counter-terrorism  training  and  presently  own  a  chemical  and  biological  decontamination  company. 
I  would  like  to  become  involved  in  homeland  security.  Is  there  someone  you  might  recommend  I  contact?” 

•  “Can  you  tell  me  how  one  would  go  about  applying  for  a  position  in  the  Homeland  Security  field?  Would  the  FBI  be 
a  start?  Thank  you  for  any  information  you  can  send  me.  I  live  in  San  Diego,  CA.” 

•  “I  would  like  to  offer  my  expertise  in  moving  individuals  to  collective  action  through  communication  campaigns. 
Could  you  please  supply  an  address  for  the  new  Office  of  Homeland  Security  announced  by  President  Bush  last 
night?” 

“While  the  attacks  were  horrible,  [Sergeant  Major  of  the  Army]  Tilley  said  he  has  noticed  increased  patriotism  among  all 
Americans,  not  just  the  military.  He  recounted  how  the  day  after  the  attacks  a  reserve  soldier  was  getting  gas  for  his  car  and  when 
he  went  to  pay,  the  attendant  said  it  was  on  him  as  the  soldier  was  helping  to  defend  the  country.  He  also  said  that  he  has  been 
getting  dozens  of  phone  calls  from  retirees  asking  if  they  can  come  back  to  help  without  pay  and  asking  how  else  they  can  help.” 

Although  MORS  will  not  pay  for  your  gas  to  get  to  the  70th  Military  Operations  Research  Society  Symposium  at  Fort 
Leavenworth  in  June  2002,  we  think  that  you  may  want  to  volunteer  your  time  to  this  area.  For  the  HLS  Special  Session,  invited 
speakers  will  present  their  perspectives  on  Homeland  Security  and  how  the  MORS  community  can  contribute.  Thank  you  in 
advance  for  highlighting  this  session  on  your  70th  MORSS  schedule.  United  we  stand! 


Workshop  Reports  I . Bell  Hall,  Classroom  2  (Arnold  Conference  Room) 

Analyzing  Effects-Based  Operations  (EBP) 

Chairs:  Dr.  Jackie  Henningseny  FS,  HQ  USAF  and  MG  Dean  Cash,  J9/JFCOM 

Technical  Chairs :  Dr  Dick  Hayes,  EBR  and  Ms.  Sue  lwanski,  SPA 

Many  of  the  organizations  both  inside  and  outside  the  DoD  community  are  interested  and  involved  in  employing  and  analyzing 
Effects-Based  Operations.  The  goal  of  this  meeting  was  to  provide  an  opportunity  to  bring  people  from  those  organizations  together 
to  share  their  work,  develop  a  common  view  of  the  state  of  the  practice,  expose  members  of  the  broader  analytic  community  to  their 
needs,  and  identify  shortfalls  and  potential  solutions. 

The  objectives  of  this  special  meeting  were  to: 

•  Achieve  an  understanding  of  the  analytical  challenge  of  Effects-Based  Operations 

•  Explore  what  tools,  data,  and  metrics  exist  or  need  to  be  developed 

•  Relate  the  concept  to  what  already  exists. 

• 

The  meeting  started  in  a  mini-symposium  format  to  bring  all  participants  up  to  speed  on  the  state  of  the  practice.  This  was 
followed  by  a  two-day  workshop  where  the  participants  met  in  working  groups  to  further  examine  specific  topics.  Working  group 
topics  were:  Decision  Support  for  Operations,  Decision  Support  for  Force  Structure  Planning,  Wargaming,  Experimentation,  and 
Exercises,  Indicators  of  Success,  Fundamental  Sciences,  and  Effects  Based  Analysis  for  Counterterrorism.  This  Special  Session  out 
brief  will  provide  a  summation  of  this  meeting,  which  was  attended  by  177  participants. 

Operations  Research  Methods  for  Information  Operations:  A  Battlespace  of  the  21st  Century 

Chair:  Dr.  Dick  Deckro,  AFIT/ENS 

The  objective  of  this  workshop  was  to  increase  the  awareness  of  the  relationship  between  10  and  OR  and  to  enhance  the 
integration  of  that  relationship.  An  overview  of  IO  was  given  the  first  day,  stressing  similarities  and  differences  in  joint  and  service 
perspectives  on  IO.  Attendees  then  broke  out  into  working  groups:  1)  MOEs/BDA  for  IO;  2)  Intel/Decision  Support  Tools;  3) 
Critical  Infrastructures  and  Defending  Information;  4)  Human  Elements  in  IO;  to  work  these  issues.  Finally,  the  presenters  and 
attendees  developed  a  set  of  IO/OR  "challenges”.  The  group  ranked  the  top  10  challenges,  outlining  the  needs  and  requirements  for 
each. 

This  Special  Session  out  brief  will  summarize  the  activities  and  findings  of  the  workshop. 
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Special  Sessions 

►  ►  ►  ►  ►  Special  Session  II  ^  ^  ^  ^  ^ 

Wednesday  -  19  June  2002  -  1530-1700 


Countering  Terrorism . Bell  Hall,  Marshall  Auditorium 

Chair:  Dr.  Bob  Clemence,  RAND 

Terrorists  have  targeted  the  United  States  more  than  any  other  country.  Several  reasons  for  this  phenomenon  suggest 
that  this  attraction  will  continue.  The  geographic  diversity  of  America’s  commercial  interests  abroad  and  the  presence  of  its 
military  bases  in  foreign  countries  provide  a  plethora  of  readily  available  targets.  Any  blow  against  the  United  States  has 
enormous  symbolic  value,  given  its  preeminent  political,  military,  and  economic  stature.  Lastly,  any  attack  on  an  American 
target  assures  publicity  and  worldwide  media  exposure.  While  earlier  terrorist  acts  against  the  United  States  did  not  threaten 
its  basic  way  of  life,  the  attacks  on  the  World  Trade  Center  and  the  Pentagon  in  September  2001  with  their  catastrophic 
consequences  in  loss  of  life,  in  property  and  in  commerce  have  propelled  terrorism  to  the  forefront  of  American  security 
concerns. 

This  session  will  host  a  panel  discussion  on  the  changing  nature  of  terrorism  and  its  implications  for  U.S.  strategy. 
Panelists  will  include: 

-  Mr.  Doug  Schultz,  IDA 

-  Mr.  Mike  Wermuth,  ESQ,  RAND 

-  LTC  William  Flynt,  TRADOC 

-  Mr.  Steven  Moniz,  TRAC 

Workshop  Reports  II . GIF,  DuPuy  Auditorium 

Analysis  of  Urban  Warfare  Workshop 

Chairs:  Ted  Smyth,  Johns  Hopkins  University  Applied  Physics  Laboratory 
Greg  Keethler,  Applied  Research  Associates,  Inc. 

This  Special  Session  will  provide  a  summation  of  the  Analysis  of  Urban  Warfare  Workshop,  conducted  at  the  Johns 
Hopkins  University  Applied  Physics  Laboratory,  Laurel,  MD,  during  the  period  of  2-4  October  2001.  In  keeping  with  this 
year’s  MORS’  theme  of  supporting  and  reaching  out  to  decision  makers,  the  workshop  focused  on  the  following  objectives: 
Gain  an  understanding  of  the  basic  characteristics,  challenges  and  decision  needs  of  current  and  anticipated  joint  urban 
combat  operations. 

Assess  the  needs  of  decision  makers. 

Perform  an  assessment  of  our  knowledge,  methods  and  existing  data,  relevant  to  joint  urban  combat  operations. 

Provide  a  list  of  candidate  actions  necessary  to  acquire  relevant  knowledge  and  data  and  to  develop  appropriate 
analytical  tools  and  methodologies  in  order  to  more  effectively  analyze  and  assess  future  warfighting  concepts, 
operations,  forces  and  systems  employed  in  an  urban  environment. 

Organizationally,  the  workshop  was  divided  into  both  plenary  and  working  group  sessions  with  the  intended  purpose  that 
the  plenary  session  on  2  October  and  luncheon  speakers  would  accomplish  the  first  two  objectives  listed  above.  Working 
group  sessions  on  3  and  4  October,  led  by  a  distinguished  group  of  MORSians,  focused  on  specific  areas  that  included:  force 
packaging  and  projection;  Intelligence,  Reconnaissance  and  Surveillance  (ISR);  Command,  Control  and  Communications 
(C3);  force  protection;  application  of  force;  mobility  and  maneuver;  support  and  sustainment;  and,  synthesis/integration. 

Significantly,  the  workshop  marked  the  first  time  that  issues  pertaining  to  urban  warfare  have  been  addressed  by  MORS 
in  over  a  decade.  Results  of  the  workshop,  attended  by  141  participants,  will  be  presented. 

Tackling  the  Space  Community's  Analytical  Challenges 

Chair:  LtCol  Suzanne  Beers ,  SMC  Det  11/CWSN 

US  Space  Command  combines  Air  Force,  Army,  and  Navy  space  components  to  provide  space-based  support  and 
combat  capabilities  to  the  warfighting  Commanders-in-Chief.  The  support  is  currently  focused  predominantly  in  the  areas  of 
communication,  navigation,  meteorology,  surveillance  and  reconnaissance.  Although  no  current  combat  capabilities  are 
provided  directly  from  space,  the  future  is  ripe  to  exploit  space  for  ’’gaining  and  maintaining  the  high  ground”.  The  MORS 
workshop  “Tackling  the  Space  Community’s  Analytical  Challenges”  focused  on  the  space  community’s  analytical 
challenges...  surveyed  current  approaches,  methodologies,  models,  tools  and  databases;  identified  gaps  in  the  existing 
analytic  capabilities;  and  proposed  workable  solutions  to  fill  the  gaps  and  support  the  needs  of  the  warfighter.  This  Special 
Session  outbrief  will  review  the  focus,  objectives,  and  outcomes  from  each  of  the  workshop's  four  working  groups:  analytical 
methods,  analytical  tools,  operational  methods,  and  sustainment  methods 
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Special  Sessions 

Junior/Senior  Analyst  Session  II 

Chair:  Jay  Wilmeth,  Northrop  Grumman  IT 

Session  two  will  be  dedicated  exclusively  to  the  junior  analyst.  We  define  junior  analyst  as  one  who  is  relatively 
new  to  the  Military  Operations  Research  world  and  will  benefit  from  the  wisdom  provided  by  those  more  seasoned  analysts 
who  have  “been  around.”  It  will  follow  a  format  that  has  been  successful  in  the  past.  There  will  be  four  meeting  rooms 
separated  along  Service  and  Joint  duty  lines  featuring  mid-level  experienced  analysts  who  are  familiar  with  the  day-to-day 
problems  and  issues  facing  the  OR  community  today.  The  sessions  will  feature  one  or  two  seniors,  each  of  whom  will 
address  the  concerns  of  the  attendees.  It  is  envisioned  that  the  questions  and  discussions  will  focus  on  career  paths  within  the 
Military  OR  world  and  other  “hot”  topics  important  to  junior  analysts.  It  is  at  this  second  session  that  junior  analysts  will 
have  the  opportunity  to  meet  with  those  more  experienced  analysts  who  are  currently  making  significant  contributions  to 
military  analysis  and  national  security  issues.  We  emphasize  that,  while  all  are  welcome,  the  focus  will  be  on  the  junior 
analyst  during  the  Wednesday  sessions.  If  last  year  was  any  indication,  the  sessions  should  feature  no-holds-barred 
discussions  and  lively  interchanges. 


Senior  Participants 

Room 

Senior  Analyst 

Room 

Senior  Analyst 

Army 

Dr.  Andy  Loerch,  GMU 

Air  Force 

Mr.  Gary  Engel,  Boeing 

GIF  253A 

COL  Jeff  Appleget,  TRAC-WSMR 

GIF  253B 

Naval 

GIF  253C 

Mr.  Dennis  Baer,  Northrop  Grumman  IT 

Dr.  George  Akst,  MCCDC 

JS/OSD 

GIF  253D 

Ms.  Anne  Patenaude,  Northrop  Grumman  IT 

COL  Ed  Cardenas,  US  CENTCOM 

►  ►  ►  ►  ►  Special  Session  III  <  <  <  <  < 

Thursday  -  20  June  2002  -  1530-1700 


Transforming  U.S.  Forces  For  The  Future  . Bell  Hall,  Marshall  Auditorium 

Chair:  Dr.  Bob  Clemence,  RAND 

Accelerating  the  transformation  of  the  U.S.  military  forces  is  a  major  theme  of  the  new  administration’s  defense  strategy. 
Military  transformation  is  distinctly  different  from  modernization.  While  modernization  replaces  or  upgrades  existing 
materiel  inventories,  transformation  evolves  and  deploys  new  combat  capabilities  that  provide  revolutionary  advantages  over 
adversaries.  The  Department  of  Defense  has  articulated  an  ambitious  transformation  vision  in  Joint  Vision  2020  and  all 
military  service  branches  have  established  transformation  roadmaps  and  activities,  including  wargames,  battle  labs/concept 
development  efforts,  and  experimentation. 

This  session  will  host  a  panel  discussion  of  the  transformation  activities  of  the  Army,  the  Navy,  the  Air  Force  and  the 
Marine  Corps.  The  aim  of  the  discussion  will  be  to  identify  the  objectives  and  desired  capabilities  of  transformation,  the 
current  service  schedules,  inter-service  dependencies  and  co-ordination,  as  well  as  the  tradeoffs  each  is  making  to  accelerate 
the  process. 


Army  COL  Bruce  Jette,  Army  Objective  Task  Force 

Air  Force  Col  Richard  Smith,  AFSAA 


Marines  COL  Arthur  Corbett 


Heritage  Session  . Bell  Hall,  Classroom  2  (Arnold  Conference  Room) 

Chairs:  Mike  Garrambone,  Venetian;  Eugene  Visco,  FS 

It  has  become  a  tradition  of  the  Military  Operations  Research  Society's  Symposia  that  there  be  a  Heritage  Session, 
identifying  the  history  of  military  operational  analysis  particularly  relevant  to  the  specific  symposium.  The  70th  MORSS  will 
continue  that  tradition. 

Speakers:  Dr.  Warren  K.  Olson  “Reflections  on  a  Career  in  Operations  Research”  and  Mr.  Arend  H.  “Pete”  Reid 
“Origins  of  Systems  Analysis  at  Aberdeen  Proving  Ground.” 
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Tutorials 


►  ►►►►►►  Tutorials  <  4  4  4  4  4  4 

Tue,  Wed,  Thurs  -  Luncheon  Tutorials  -  18, 19,  20  June  2002  -  1215-1315 


Coordinator :  Dr.  Andrew  Loerch ,  GMU 

Tutorial  On  Step  #1  Of  The  Scientific  Method:  How  To  Define  A  Problem . Tuesday,  GIF,  DuPuy  Auditorium 

Roy  E.  Rice,  Ph.D.,  Teledyne  Brown  Engineering 

This  tutorial  is  intended  to  teach  a  repeatable  process  for  accomplishing  the  first  step  in  the  Scientific  Method  -  defining  the  problem. 
This  is  the  most  crucial  step  in  beginning  any  analysis  or  study.  Not  defining  the  problem  correctly  will  ensure  that  the  study  will  fail  to  meet 
the  customer's  expectation.  The  best  analysis  performed  on  the  wrong  problem  results  in  wasted  resources  and  a  frustrated  decision  maker. 
Many  of  our  educational  institutions  do  a  tremendous  job  of  teaching  the  analytical  methods  and  tools  used  in  executing  an  analysis. 
However,  our  educational  efforts  do  little  to  teach  our  young  analysts  how  to  adequately  define  the  problem.  This  tutorial  focuses  on 
involving  the  decision  maker,  a  methodical  approach  (template)  for  describing  the  problem,  and  the  context  in  which  it  is  used  in  the  analysis 
process.  The  intended  audience  is  the  beginning  analyst  and  the  analysis  agency's  managers  who  must  train  the  analyst  in  the  art  of  problem 
solving. 

Spreadsheet  Analysis . Tuesday  4  Wednesday,  Bell  Hall,  Marshall  Auditorium 

CDR  Matt  Boensel,  Department  of  Operations  Research,  Naval  Postgraduate  School 

A  popular  general-purpose  spreadsheet  program  such  as  Microsoft  ®  Excel  is  widely  available  to  analysts  everywhere,  and  may  be  the 
only  analysis  tool  available  in  many  military  operational  commands.  However,  spreadsheets  are  typically  less  used  in  OR  graduate 
programs  than  more  specialized  statistics,  simulation,  or  optimization  software  packages.  We  highlight  some  of  the  OR  methods  which  are 
amenable  to  spreadsheet  application  and  some  which  are  not,  and  demonstrate  a  few  advanced  capabilities  within  spreadsheets  (e.g. 
simulation).  This  tutorial  is  based  on  a  capstone  course  taught  at  NPS,  in  which  we  tie  together  the  concepts  and  techniques  learned  in  the 
Operations  Analysis  curriculum  (using  specialized  software  packages)  into  a  set  of  tools  that  the  officer- students  can  apply  in  any  setting. 
While  the  content  of  the  course  is  accessible  to  students  with  limited  foreknowledge,  the  significance  of  determining  which  techniques  can 
be  appropriately  implemented  on  the  spreadsheets  cannot  be  understated. 

Top  Ten  Secrets  for  Successful  Application  of  Optimization . Wednesday,  GIF,  DuPuy  Auditorium 

Dr.  Gerald  G.  Brown,  Distinguished  Professor  of  Operations  Research,  Naval  Postgraduate  School 

There  are  some  key  differences  between  a  textbook  optimization  model  and  the  real  thing.  Models  that  have  any  chance  of  succeeding 
on  their  own  in  the  real  world  have  features  that  textbooks  don't  mention.  This  is  too  bad,  because  without  these  essentials  a  model  has 
scant  chance  of  seeing  real-life  application  by  anyone  but  its  original  developers.  Recent  DoD  case  studies  show  examples  of  the  most 
valuable  model  features  that  are  most  often  neglected. 

Dr.  Gerald  G.  Brown  is  Distinguished  Professor  of  Operations  Research  at  the  Naval  Postgraduate  School,  where  he  has  taught  and 
conducted  basic  and  applied  research  in  optimization  theory  and  optimization-based  decision  support  since  1973.  His  military  research  has 
been  applied  by  every  uniformed  service,  in  areas  ranging  from  strategic  nuclear  targeting  to  capital  budgeting.  He  has  been  awarded  the 
Rist  Prize  for  military  operations  research.  He  has  designed  and  implemented  decision  support  software  currently  used  by  two-thirds  of  the 
Fortune  50,  in  areas  ranging  from  vehicle  routing  to  supply  chain  optimization.  His  research  appears  in  scores  of  open-literature 
publications  and  classified  reports,  many  of  which  are  seminal  references  in  the  field.  He  has  earned  long-term  basic  research  support  from 
the  Air  Force  Office  of  Scientific  Research,  and  the  Office  of  Naval  Research. 

Complex  Adaptive  Systems  and  Agent  Modeling  for  Military  Analysis . Thursday,  Bell  Hall,  Marshall  Auditorium 

Lt  Col  Raymond  R.  Hill  and  Capt  Lance  Champagne,  Department  of  Operational  Sciences,  Air  Force  Institute  of  Technology 

An  interesting  area  of  research,  both  theoretical  and  applied,  is  the  “new  sciences”  which  encompass  topics  such  as  chaos  and 
complexity,  complex  adaptive  systems  and  artificial  life.  The  military  analytical  community  has  become  increasingly  interested  in  these 
sciences  evidenced  by  recent  mini-symposiums  and  the  special  issue  in  Military  Operations  Research ,  and  the  increasing  number  of 
presentations  at  the  Military  Operations  Research  Society  Symposia.  This  interest  should  not  be  construed  as  passing  fancy;  at  least  we 
should  hope  not.  Rather,  this  interest  should  be  viewed  as  an  opportunity  to  improve  our  abilities  to  analyze,  model,  and  understand 
warfare. 

Agent  modeling  and  complex  adaptive  systems  promise  a  new  modeling  paradigm  for  military  simulation.  Combat  is  widely 
recognized  as  a  chaotic  system  where  various  intangibles,  such  as  leadership,  are  often  the  keys  to  success  in  the  battles  and  ultimately  the 
war.  Conversely,  failure  on  the  battlefield  is  not  always  due  to  overwhelming  force.  Military  incompetence  is  most  expensive  when 
manifest  among  the  military  leadership.  The  promise  of  agent  modeling  for  military  modeling  is  its  seeming  ability  to  bring  the  cognitive 
role  of  leadership  into  the  military  model.  Software  agent  technology  is  well  capable  of  providing  situational  assessment  functions, 
information  fusion  abilities,  and  various  rule-based  behaviors.  However,  achieving  true  cognition  in  a  software  agent  is  still  an  unrealized 
dream. 

The  challenge  is  determining  where  agent  modeling  can  assist  military  modeling,  how  this  technology  will  provide  that  help,  and 
determining  the  technical  challenges  that  remain  to  fully  realize  the  promise  of  agents  in  military  modeling  particularly  as  agent  technology 
is  applied  to  models  higher. 

In  this  tutorial  we  cover  some  of  the  underlying  concepts  of  chaos  and  complexity.  We  then  discuss  some  uses  and  applications  of 
cellular  automata  models  and  agent  based  models  particularly  as  applied  to  military  problems.  During  these  overviews  we  discuss  some  of 
the  challenges  associated  with  agent  models  particularly  in  the  analysis  of  output  data.  We  also  provide  an  update  on  military-related 
research  efforts  in  CAS  and  agent-modeling  to  include  the  Defense  Modeling  and  Simulation  Office  sponsored  Bay  of  Biscay  study. 
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Poster 


Session  and  Job  Fair 


►  ►  ►  ►  ►  poster  Session  ^  ^  ^ 

All  day  Tuesday  &  Wednesday  -  18  - 19  June  2002 
GIF,  First  Floor  Lobby 

Coordinator:  Sherry  Barnes,  sbarnes(a)jwac.  osis.  gov 

The  70th  MORSS  Poster  Session  will  be  on  continuous  display  in  the  General  Instruction  Facility  (GIF)  on  Tuesday 
and  Wednesday  (18-19  June  2002).  This  venue  will  provide  both  viewers  and  presenters  opportunities  to  meet,  view  and 
discuss  presentations. 

Hard  and  Deeply  Buried  Target  Defeat  Capability  Analysis  of  Alternatives  Lethality  Approach 

Kara  J.  Peterson.  Frank  A.  Maastes  ,  John  C.  Galloway,  Applied  Research  Assoc,  Inc  (ARA),  Richard  Freet.  HQ 
ACC/XRYF  and  Maj  Michael  Hockenberger,  HQ  ACC/XRMA 

The  Hard  and  Deeply  Buried  Target  Defeat  Capability  (HDBTDC)  Analysis  of  Alternatives  (AOA)  was  a  tri-service 
effort  led  by  the  Air  Force  Air  Combat  Command  (ACC)  and  Air  Force  Space  Command  (AFSPC)  to  determine  the  best 
weapon  system  solution  for  the  defeat  of  hard  and  deeply  buried  targets.  This  paper  describes  the  methodology  and  approach 
used  for  the  lethality  analysis  portion  of  the  HDBTDC  AOA. 

The  HDBTDC  AOA  was  performed  in  three  steps.  Under  Step  1,  measures  of  performance  and  measures  of 
effectiveness  were  defined.  In  addition,  representative  hard  targets  were  chosen  for  the  template  target  set  and  defeat 
mechanisms  were  defined  for  each  template  target  based  on  the  target  function  and  the  amount  of  intelligence  data  available 
on  the  specific  target.  In  Step  2,  a  screening  analysis  was  completed  that  used  simplified  algorithms  to  analyze  the 
effectiveness  of  the  conceptual  weapon  systems  against  the  template  target  set.  The  weapon  system  concepts  were  then 
compared  within  categories  to  select  the  most  promising  candidates  for  additional  analysis.  Based  on  this  comparison, 
generic  weapons  were  designed  to  improve  performance  in  each  category.  In  Step  3  a  detailed  analysis  was  completed  in 
which  the  best  systems  in  each  category  from  Step  2  and  the  generic  weapon  concepts  were  evaluated  in  more  detail  using  the 
Modular  Effectiveness  and  Vulnerability  Assessment  (MEVA)  code.  Step  3  also  included  an  excursion  analysis  that  tested 
the  robustness  of  weapon  system  concepts  against  targets  for  which  there  is  uncertainty  in  physical  and  functional  definition. 


►  ►  ►  ►  ►  Sponsors’  Job  Fair  ^  1  1  1  1 

Bell  Hall  -  Trophy  Lounge 

Coordinator:  Corinne  Wallshein,  Corinne.  wallshein(cv, pentagon.  qfmU_ 

What:  70th  MORSS  Sponsors’  Job  Fair  for  Civilian  Operations  Research  Analysts 

When:  Tuesday  from  1530  to  1700 

Wednesday  from  1230  to  1430 
Thursday  from  0830  to  1030 

Where:  Bell  Hall,  Trophy  Lounge 

How  &  Who:  Learn  about  Civilian  Operations  Research  Analyst  opportunities  and  upcoming  vacancies 
in  DOD  analysis  organizations.  If  you  are  interested  in  Federal  employment,  come  look  at  what's  out 
there,  see  what  may  be  opening  in  the  future  and  chart  the  Next  Frontier  in  your  career.  Sponsors  with 
immediate  and  planned  job  vacancies  will  provide  a  representative  to  discuss  these  opportunities  with 
you.  Sign  up  sheets  will  be  available  in  the  Trophy  Room  for  private  sessions  to  discuss  specific 
vacancies.  For  those  sessions,  bring  your  resume  to  leave  with  the  sponsor's  representative. 
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Composite  Groups 

►  ►  ►  Composite  Groups  <  <  < 


COMPOSITE 

GROUP 

DATE/TIME 

TITLE 

AUTHOR 

ROOM 

Tuesday 

A  18  June 

1330-1500 

LTC  Debra  Schnelle, 

CBRNE  Hazard  Analysis  Office  of  The  Surgeon 

General 

GIF, 

DuPuy 

Auditorium 

Weapons  of  Mass 

Destruction  -  Impact  on 

Army  Operations 

MAJ  Jon  Payne,  CAA 

B 

Tuesday 

18  June 

1330-1500 

Al  Qaeda  and  the  “Imposed 
Symmetry  Model” 

Dr.  George  Friedman 

Bell  Hall, 
Marshall 
Auditorium 

Wednesday 

C  19  June 

0830-1000 

Metrics  for  Transformation 

Cynthia  Dion-Schwarz 

Institute  for  Defense 
Analyses 

Bell  Hall, 
Marshall 
Auditorium 

JWARS  History  and  Insights 

Jim  Metzger,  JWARS 

D 

Wednesday 

19  June 

1330-1500 

Developing  Aerospace 
Leaders  Overview 

Maj  Gen  Chuck  Link 
(USAF  retired) 

Bell  Hall, 
Marshall 
Auditorium 

Brig  Gen  Richard  S. 
Hassan,  USAF 

Lt  Col  Jennifer  L. 
Graham,  USAF 

Wednesday  Strategic  Plan  for  nflnipi  f  Garrinpr  Bell  Hall, 

E  1 9  June  Transforming  DoD’s  g™'  Cl  V5araner-  Marshall 

1030-1200  Training  Auditorium 

F 

Wednesday 

19  June 

1330-1500 

Measuring  the  Value  of 
Prewar  C4I,  and  Costing  the 
Contribution  of  C4I  to  the 
Weapon  System 

Joseph  F.  Auletta, 

AFMC  OAS/DR 

GIF, 

DuPuy 

Auditorium 

Measures  of  Effectiveness  .  |R  p  , 

Applied*  Joint  Conba,  ^“rp. 

Identification 
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Composite  Groups 

Composite  Group  A  —  Strategic  &  Defense 

Working  Groups  1,  2,  3,  4 
Chair:  Julia  Klare  Burr,  IDA 
Co-chairs:  Debbie  Lott,  Center  for  Army  Analyses 
Tom  Pendergast,  Modern  Technology  Solutions 
Advisor:  William  Beardon,  Los  Alamos  National  Laboratory 

Tuesday-18  June-1330-1500 
GIF,  DuPuy  Auditorium 


CBRNE  Hazard  Analysis 

LTC  Debra  Schnelle 

Medical  NBC  Staff  Officer 

HQDA,  Office  of  the  Surgeon  General 

5111  Leesburg  Pike,  Suite  401 

Falls  Church,  VA  22041 

703-681-8185 

(fax  703-681-4971) 

debra.schnelle@otsg.amedd.armv.mil 

The  spectrum  of  CBRNE  threats  is  highly  varied  and  almost  unlimited  in  scope,  ranging  from  contamination  of  food 
supplies  to  attacks  against  industrial  chemical  facilities  to  large  scale  aerosol  releases  of  biological  agent  or  detonation  of 
nuclear  devices.  In  these  circumstances,  threat-based  planning-identifying  every  possible  threat  and  planning  appropriate 
actions  to  mitigate  them— is  likely  to  be  a  futile  undertaking,  in  that  any  such  effort  may  well  overlook  the  threat  that 
ultimately  materializes,  and  leave  us  unprepared  to  manage  the  consequences. 

As  an  alternative,  the  CBRNE  Hazard  Analysis  now  being  sponsored  by  the  US  Army  Office  of  the  Surgeon  General 
(OTSG)  seeks  to  lay  the  foundation  for  a  shift  from  threat-based  to  capability-based  planning  in  the  medical  arena.  This 
approach  uses  modeling  and  simulation  tools  to  characterize  the  impact  of  CBRNE  hazards  and  requirements,  here  defined  in 
terms  of  scale  of  prospective  casualties  and  resources  required  to  treat  them.  By  assessing  hazards  based  on  their 
consequences,  rather  than  their  individual  characteristics,  OTSG  hopes  to  generate  a  common  basis  for  understanding 
CBRNE  hazards  within  the  military  and  civilian  medical  communities,  which  can  then  be  used  to  prioritize  efforts  and 
resources  devoted  to  generating  the  capabilities  to  respond  to  them. 

Weapons  of  Mass  Destruction  —  Impact  on  Army  Operations 

MAJ  Jon  Pavne 

Center  for  Army  Analyses 
6001  Goethals  Road,  Suite  102, 

Fort  Belvoir,  VA,  22060-5230 
703-806-5495 
(fax  703-806-5725) 
pavne@caa.armv.mil 

Recent  WMD  studies  have  focused  on  the  effects  at  specific  nodes  during  force  projection  or  during  offensive/defensive 
operations  in-theater.  These  studies  are  stand-alone  and  not  linked  to  provide  a  comprehensive  assessment  of  the  effects  on 
the  Army  across  the  spectrum  of  operations  and  across  lines  of  communication.  This  study  examined  previous  studies  to 
determine:  Army  WMD  vulnerabilities  during  the  Mobility,  Deployment  and  Employment  phases  of  Force  Projection; 
planning  guidance  to  reduce  impact  on  operations  by  threat  use  of  WMD  to  deny  or  limit  LOCs;  provide  insights  and 
recommendations  for  changes  in  WMD  defense  to  reduce  vulnerabilities.  Analysis  methodology  is  described  and  results  are 
shown. 
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Composite  Groups 

Composite  Group  B  —  Space/C4ISR 

Working  Groups  5,  6,  7,  8,  9, 10, 11 
Chair:  Dr.  Ted  Bennett,  Naval  Oceanographic  Office 
Tuesday-18  June-1330-1500 
Bell  Hall,  Marshall  Auditorium 


Al  Qaeda  and  the  “Imposed  Symmetry  Model” 

Dr.  George  Friedman 

Strategic  Forecasting,  LLC  (Stratfor.com) 

700  Lavaca,  Suite  405,  Austin,  TX  78701 

Phone:  (512)  744-4300,  Fax:  (512)  744-4334,  Friedman@stratfor.com 

The  problem  of  al  Qaeda  has  posed  a  unique  challenge  to  U.S.  war  fighting  practices.  The  logical  hierarchy  of  U.S. 
warfighting  doctrine  ranges  from  global,  high  intensity  conflict  against  symmetric  forces  down  to  localized,  low  intensity 
conflict  against  asymmetric  forces.  Al  Qaeda  confounds  this  model  by  posing  a  global,  low  intensity  challenge  from  a  sparse 
and  diffuse  network  of  operatives.  This  has  created  a  conceptual  challenge  for  the  United  States.  The  combination  of  a  global 
challenge  against  a  sparse,  irregular  force  is  not  only  difficult  to  conceptualize  it  is  also  extremely  difficult  to  model.  The 
enemy  contains  too  few  pieces  with  too  many  options  for  prediction.  This  was  the  problem  faced  by  Israel  during  the  latest 
wave  of  suicide  bombings.  Israel’s  solution  was  to  decline  combat  on  the  terms  being  set  by  the  Palestinians  and  convert  the 
war  into  a  warfighting  paradigm  that  was  suited  to  Israeli  needs.  While  there  are  many  differences,  on  the  highest  level,  the 
Israeli  model  is  one  that  the  United  States  is  clearly  examining  on  a  global  basis  and  which  must  be  examined  by  the 
simulation  and  modeling  community.  We  will  call  this  the  “imposed  symmetry”  model  of  warfare. 


Composite  Group  C  —  Joint  Warfare 

Working  Groups  12, 13, 14, 15, 16, 17 
Chair:  Robert  C.  Holcomb,  Institute  for  Defense  Analyses 

Wednesday-19  June-0830-1000 
Bell  Hall,  Marshall  Auditorium 


Metrics  for  Transformation 

Cynthia  Dion-Schwarz 

Institute  for  Defense  Analyses 

4850  Mark  Center  Drive,  Alexandria,  VA  22311 

(703)  578-2885,  (703)  578-2877,  cdion@ida.org 

The  2001  Quadrennial  Defense  Review  identifies  six  operational  goals  as  the  focus  for  the  DoD’s  immediate 
transformation  efforts.  In  this  paper,  we  discuss  the  framework  for  thinking  about  the  six  goals.  This  framework  recognizes 
that  three  of  the  goals  (Assure  Information  Systems,  Enhanced  Space  Systems  and  Leverage  Information  Technology)  can  be 
thought  of  as  leading  to  Decision  Superiority,  and  enabling  new  ways  to  fight,  especially  in  the  Joint  arena.  The  other  three 
goals  (Protecting  Bases  of  Operations,  Force  Projection  in  Anti-Access  Environments  and  Deny  Enemies  Sanctuary)  can  be 
seen  as  more  traditional  operational  goals  that  are  transformational  when  performance  is  greatly  extended  beyond  current 
capabilities. 

For  each  of  the  six  goals,  enabling  capabilities  were  identified  that  are  key  to  achieving  transformational 
capabilities,  along  with  metrics  that  could  be  used  to  measure  progress.  We  give  examples  of  metrics  for  these  enabling 
capabilities  that  can  be  used  to  understand  progress  toward  transformation.  Lastly,  we  discuss  how  the  metrics  can  be  used  to 
advance  transformation  by  analyzing  an  investment  strategy,  by  providing  guidance  on  gaps,  and  by  measuring  near-term 
progress. 

JWARS  History  and  Insights 

Jim  Metzger 

Director,  JWARS  Office,  1555  Wilson  Blvd,  #620,  Arlington  VA  22209-2405 
703-696-9490  FAX  703-696-9563,  iim.Metzger@osd.pentagon.mil 

This  presentation  is  a  management-oriented  review  of  the  Joint  Warfare  System  (JWARS)  development  project. 
JWARS  is  a  theater-level  warfare  simulation  being  developed  to  support  Department  of  Defense  decision  making.  The 
presentation  describes  the  history  of  the  program  -  from  inception  in  1995  through  the  present  -  as  well  as  its  status.  All 
aspects  of  development  are  covered,  including  management  oversight,  requirements,  infrastructure,  technical  approach, 
development  team,  data,  and  user  participation.  The  presentation  concludes  with  insights. 
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Composite  Groups 


Composite  Group  D  —  Resources 

Working  Groups  18, 19,  20 
Chair:  Herb  Shukiar,  RAND 

Wednesday-19  June-1330-1500 
Bell  Hall,  Marshall  Auditorium 


Developing  Aerospace  Leaders  Overview 

Lt  Col  Jennifer  L.  Graham 
HQ  USAF/DP-DAL 
2211  Jefferson  Davis  Hwy 
Crystal  Plaza  5,  Suite  310 
Arlington  VA  22202 


Brig  Gen  Richard  S.  Hassan 

AFSLMO 

1215  Jefferson  Davis  Hwy  #1002 
Arlington  VA  22202 


Maj  Gen  Chuck  Link  (USAF  retired) 
HQ  USAF/DP-DAL 
221 1  Jefferson  Davis  Hwy 
Crystal  Plaza  5,  Suite  310 
Arlington  VA  22202 


The  Developing  Aerospace  Leaders  (DAL)  program  was  initiated  by  directive  of  the  Air  Force  Chief  of  Staff  to  develop 
and  implement  deliberate  leadership  processes  for  the  Total  Force.  The  objective  of  this  initiative  is  to  ensure  that  Air  Force 
officers,  civilians  and  enlisted  members  have  the  competencies  needed  to  operate  in  the  battle  space  of  the  future. 
Competencies  include  skills,  knowledge,  and  abilities  related  to  specific  occupations,  as  well  as  universal  characteristics 
considered  desirable  regardless  of  a  member’s  occupation.  The  DAL  construct  focuses  on  ensuring  that  required 
competencies  for  each  position  are  instilled,  through  training,  education,  and/or  experience,  throughout  the  entire  Air  Force. 

The  DAL  initiative  started  as  a  study  in  the  July  ’99  timeframe  and  has  evolved  into  a  recognized  part  of  the  institution 
and  a  formal  DAL  Support  Office  has  been  established  within  the  Air  Staff. 


Composite  Group  E  —  Readiness/Training 

Working  Groups  21,  22,  23 
Chair:  LTC  Greg  McIntyre,  JWARS  Program  Office 

Wednesday-19  June-1030-1200 
Bell  Hall,  Marshall  Auditorium 


Strategic  Plan  for  Transforming  DoD ’s  Training 

Dan  Gardner 

OSD  Readiness  &  Training 

The  2001  Quadrennial  Defense  Review  recognized  transformed  training  would  be  a  key  enabler  toward  achieving 
the  operational  goals  of  the  overarching  Transformation  of  the  Department  of  Defense.  The  Defense  Planning  Guidance  for 
FY  2003-07  directed  the  Under  Secretary  of  Defense  for  Personnel  and  Readiness  (USD  (P&R))  to  work  with  the  Secretaries 
of  the  Military  Departments,  the  Chairman  of  the  Joint  Chiefs  of  Staff,  the  Combatant  Commander  of  US  Joint  Forces 
Command,  and  Under  Secretary  of  Defense  for  Acquisition  Technology  and  Logistics  to  develop  a  strategic  plan  to  transform 
military  training  to  better  enable  Joint  Force  operations.  A  defense-wide  collaborative  effort  was  undertaken  to  develop  a 
requested  Strategy  Plan,  a  vision,  goals,  and  road  map  for  implementation.  A  four- star  Executive  Steering  Group  chaired  by 
the  USD(P&R),  Dr.  David  Chu,  and  a  three  and  two-star  Senior  Advisory  Group,  chaired  by  the  Deputy  Under  Secretary  of 
Defense  for  Readiness,  Dr.  Paul  Mayberry,  were  established  with  a  Training  Transformation  Integrated  Process  Team  of 
senior  level  analysts,  planners,  and  action  officers  for  support.  These  groups  collectively  developed  the  strategic  plan  and 
submitted  it  to  the  Secretary  of  Defense  on  1  March. 
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Composite  Groups 

Composite  Group  F  —  Acquisition 

Chair:  John  Ferguson  (Northrop  Grumman  Information  Technology) 

Co-chair:  Harlan  Loomis  (MITRE) 

Advisor:  Mike  Lavine  (MITRE) 

Wednesday-19  June-1330-1500 
GIF ,  DuPuy  Auditorium 


Measuring  the  Value  of  Prewar  C41 ,  and  Costing  the  Contribution  of  C4I  to  the  Weapon  System 

Mr  Joseph  F.  Auletta 

Office  of  Aerospace  Studies  AFMC/DR 

3550  Aberdeen  Ave  SE 

Kirtland  AFB,  NM  87717-5778 

505-846-8214 

fax:  505-846-5558 

Joseph.Auletta@kirtland.af.mil 

The  nature  of  major  Air  Force  system  acquisitions  is  substantially  changing.  The  systems  themselves  are  much 
more  information  dependent,  and  many  of  the  Analyses  of  Alternatives  (AoA’s)  for  these  acquisition  systems  must  address  a 
trade  of  money  spent  on  information  vs.  money  spent  on  warhead.  This  presentation  will  focus  upon  several  significant  steps 
the  Air  Force  has  taken  to  improve  how  it  analyzes  the  value  of  information  in  AOA’s,  some  still-needed  improvements,  and 
some  problem  areas,  as  we  continue  to  adapt  the  AoA  process  for  C4I  systems.  The  specific  areas  of  discussion  include  how 
to  cost  C4I  support  to  a  weapon  system  and  how  to  measure  the  “value”  of  C4I  in  a  pre-war  environment. 


Measures  of  Effectiveness  Applied  to  Joint  Combat  Identification 

Mr  Joel  R.  Parker  Contractor 
JCIET  Command,  JFCOM 
Eglin  AFB,  FL  32542 
(850)  882-6700,  Ext.  #7524 
ioel.parker@eglin.af.mil 

Emerging  requirements  within  DoD  now  challenge  the  newly  designated  Joint  Combat  Identification  and  Evaluation 
Team  (JCIET)  Command  as  it  looks  to  plan  future  evaluations.  These  emerging  requirements  are  (1)  The  conduct  of  CID 
evaluations  within  established  joint  exercises;  and,  (2)  Evaluations  of  the  Key  Performance  Parameters  (KPPs)  stated  in  the 
newly  approved  Combat  Identification  (CID)  Capstone  Requirements  Document  (CRD). 

The  JCIET  Command  serves  as  a  joint  activity  under  the  command  &  control  of  the  Joint  Forces  Command 
(JFCOM)  to  evaluate  the  joint  mission  area  of  Combat  Identification  (CID).  The  objective  of  Command  participation  in  the 
2002  Military  Operations  Research  Society  Symposium  (MORSS)  is  to  interact,  through  an  information  presentation,  with 
the  MORS  community.  This  proposed  interaction  would  focus  on  emerging  requirements  driving  Measure  of  Effectiveness 
(MOE)  refinements/developments  for  the  Command.  The  scope  of  the  presentation  would  be  limited  to  the  practical  use  of 
MOEs  for  root-cause  analysis  in  evaluating  the  formal  joint  Mission  Area  of  Combat  Identification. 

Root-cause  analysis  does  not  employ  statistical  techniques.  The  Command  is  largely  limited  to  this  method  of 
analysis  because  of  the  employed  method  for  collecting  data.  All  data  is  collected  during  an  evaluation  conducted  over  a  two- 
week  period  within  a  live,  dynamic  joint  environment  allowing  the  prosecution  of  free  play  operations.  Collected  data  allows 
detailed  mission  reconstruction  and  supports  rigorous  analysis  of  evaluation  objectives. 

JCIET  Operations  are  joint  in  nature  and  comprise  joint  task  force  resources.  Such  operations  employ  select  land, 
sea  and  air  weapons  platforms,  staffs  and  forces  across  all  of  the  Services.  These  resources  are  “networked”  with  Command 
and  Control  (C2)  and  Intelligence,  Surveillance  and  Reconnaissance  (ISR)  systems.  ISR  systems  include  all  levels  of  conflict, 
i.e.  National  Technical  Means  (NTM),  operational  and  tactical.  “Networking”  consists  of  existing  or  developmental  tactical 
data  networks. 

The  JCIET  Command  welcomes  the  opportunity  to  provide  an  information  presentation  to  interested  members  of  the 
MORSS  community  regarding  refinements  and  use  of  established  MOEs  to  assist  root-cause  analysis  associated  with  these 
two  emerging  requirements. 


12 


Demonstrations 


►  ►  ►  ►  Demonstrations  <  i  i  * 

All  day  Tuesday  &  Wednesday  -  18  - 19  June  2002 
Thursday  -  20  June  2002-  0830-1200 


Coordinator:  Bill  Dunn ,  IITRI 


Synthetic  Theater  Operations  Research  Model  (STORM)  Demonstration . GIF  Room  254D 

Major  Bryn  Turner 

STORM  Project  Mgr 

AFSAA/SAAP 

1570  Air  Force  Pentagon 

Washington  DC  20330-1570 

703-588-6923 

Fax:  703-588-8759 

bryn.tumer@pentagon.af.mil 

STORM,  the  U.S.  Air  Force’s  next-generation  campaign  analysis  model,  is  due  for  operational  release  in  December 
2002.  As  a  follow-on  to  the  current  model,  Thunder,  STORM  represents  the  USAF’s  contribution  to  next-generation,  theater, 
campaign  analysis  with  representation  of  air  and  space  power  in  a  Joint  context  while  incorporating  flexible  design 
philosophy,  innovative  OO  structures,  and  beginning-to-end  analysis  support.  The  STORM  development  mission  is  to 
provide  USAF  analysts  with  a  high-quality,  DoD-compliant  campaign  analysis  capability  possessing  believable 
representations  of  warfighting  activities  and  functional  user  interfaces. 

STORM  represents  a  new  approach  in  analytic  simulation  utility  with  a  maximum  use  of  freeware/GOTS  software  (GNU 
compiler,  MySQL  database,  MS  Office™  tools,  Oilstock  Mapping,  et  at)  and  multi -platform  compatibility  (currently  SUN- 
Solaris,  PC-Linux,  with  PC-NT  in  progress).  The  Common  Analysis  Simulation  Architecture  (CASA)  is  an  OO,  C++ 
framework  designed  to  link  simulations  to  database  mechanisms,  input  interfaces,  and  output  visualization  and  analysis  tools. 
STORM  is  currently  one  of  two  Air  Force  simulations  to  take  advantage  of  CASA  and  has  been  readily  linked  to  three 
database  mechanisms  and  five  visualization  packages  in  as  little  as  one  day  for  installation.  This  highly  reconfigurable 
approach  to  analytic  systems  allows  users  to  define  their  own  custom  analysis  tool  suite  with  the  goal  of  significantly 
reducing  life  cycle  costs. 


Joint  Warfare  System  (JWARS)  Overview  and  Demo . GIF  Room  358C 

Dr.  Jim  Metzger.  Director 
JWARS 

1555  Wilson  Blvd.  (Suite  620) 

Arlington,  VA  22209 
Phone:  (703)  696-9490 
FAX:  (703)  696-9563 
Jim.Metzger@OSD.pentagon.mil 

The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  closed-form  constructive  simulation  that  will  provide  a 
multi-sided  and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  Combatant  Commanders, 
Joint  Staff,  Services,  Office  of  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS  will  be  capable  of 
performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  its  Full  IOC,  and  will  be  able  to  System  Effectiveness 
Analyses  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  its  FOC. 

This  Presentation  will  provide  an  overview  and  demonstration  of  the  JWARS  project.  It  will  provide  a  discussion  on  the 
background  of  JWARS,  how  oversight  of  the  program  is  conducted,  an  overview  of  the  requirements  process,  some  of  the 
development  techniques,  and  a  quick  look  at  the  evaluation  process.  It  will  also  include  a  Video-Playback  Demonstration  of 
JWARS  functionality. 
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Demonstrations 

Joint  Modeling  and  Simulation  System  (JMASS)  Putting  Flesh  on  the  Reuse  Efficiency  Bones! 
. GIF,  Room  358D 


Robert  J.  Mever 

ASC/AAJ  (JMASS  JPO) 

2145  Monahan  Way  Bldg  28 
Wright  Patterson  AFB  OH  45433-7017 
937-255-3969  ext  3818 
Bob.Mever@wpafb.af.mil 

In  previous  papers,  the  author  revealed  what  JMASS  is,  does  implies  and  means,  establishing  how  this  object-oriented, 
paradigm-shifting,  digital,  constructive,  engagement-level  modeling  and  simulation  (M&S)  architecture  offers  remarkable 
software  reuse  efficiencies,  and  at  the  same  time  seriously  challenges  the  DoD  to  realize  those  efficiencies.  In  this  paper,  the 
author  focuses  on  a  specific  JMASS  application  area  -  aircraft  combat  survivability  -  and  lays  out  a  process  and  an 
infrastructure  to  meet  this  challenge  and  bring  the  M&S  reuse  bugaboo  to  its  knees.  Key  to  this  process  for  JMASS-based 
survivability  M&S  tools  is  maximal  leveraging  of  the  best  features  of  the  existing  processes,  e.g.,  using  established 
relationships  and  time-proven  configuration  management  and  software  maintenance  approaches.  Key  to  the  infrastructure 
which  must  needs  exist  to  support  this  process  is  once  again  maximal  leveraging  of  existing  management  structures,  e.g., 
refining  application-specific  user  groups  to  reflect  the  new,  JMASS  way  of  crafting  M&S  solutions  to  survivability 
community  problems.  Key  to  both  this  process  and  infrastructure  is  a  mechanism  for  documenting  in  an  understandable  and 
meaningful  way  the  requirements  for  and  capabilities  inherent  in  the  JMASS  paradigm.  This  paper  concludes  by  proposing  a 
three-dimensional  fabric,  woven  of  process,  infrastructure  and  mechanism,  and  offering  the  realization  of  these  reuse 
efficiencies  for  the  aircraft  combat  survivability  community. 


NBC  Casualty  and  Resource  Estimation  Support  Tool  (NBC  CREST) 


GIF  254A 


Dr.  Gene  McClellan,  PhD 

Veridian  Systems  Division,  Inc. 

1400  Key  Blvd.  Suite  700 
Arlington,  VA  22209 

Phone:  (703)  516-6204  FAX:  (703)  524-2420 
Email:  Gene.McClellan@Veridian.com 


Sharon  Watts 
ScenPro,  Inc. 

101  W.  Renner  Road  Suite  130 

Richardson,  Texas  75082 

Phone:  (972)  437-500 1  FAX:  (972)  437-36 1 1 

E-mail:  Swatts@ScenPro.com 


The  Nuclear,  Biological,  and  Chemical  Casualty  Resource  Estimation  Support  Tool  (NBC  CREST)  supports  deliberate 
medical  planning  in  an  iterative,  integrated  process  for  US  Army  medical  planning  at  the  Corps,  Division,  and  Corps  Medical 
Brigade  levels. 

NBC  CREST  provides  an  analysis  capability  designed  to  estimate  the  potential  for  casualties,  medical  requirements, 
available  resources,  and  evaluate  alternative  medical  courses  of  action  in  the  NBC  environment.  The  tool  provides  casualty 
estimation  based  on  a  user-defined  NBC  scenario,  detailing  the  deployment  and  defensive  posture  of  combat  personnel  and 
rear  area  personnel  together  on  a  map-based  graphical  user  interface.  NBC  casualty  scenarios  may  be  developed  in 
accordance  with  current  threat  assessments  and  planning  guidance.  Based  on  the  resulting  patient  stream,  the  tool  provides  a 
time-phased  estimate  of  the  required  medical  resources  for  patient  treatment  and  an  analysis  of  potential  medical  courses  of 
action  for  an  assessment  of  medical  resource  sufficiency  based  on  the  deployed  medical  support  network. 

The  capability  of  deployed  medical  resources  to  meet  demand  is  analyzed  and  the  results  are  displayed.  Depending  on 
the  required  level  of  resource  satisfaction  and  detail  required,  the  user  may  iteratively  modify  existing  deployed  medical 
resources  down  to  the  unit  level  to  resolve  potential  resource  shortfalls,  or  evaluate  the  benefits  of  additional  medical  support 
during  the  planning  stages  of  a  mission.  Subsequent  analyses  will  show  how  well  the  new  medical  Course  Of  Action  resource 
set  satisfies  the  requirements. 

A  comparison  of  two  or  more  medical  courses  of  action  based  on  Deployment,  Disposition,  and  Utilization  (DDU) 
criteria  assist  the  user  in  identifying  the  optimal  medical  course  of  action,  where  the  lowest  rank  indicates  the  best  overall 
performance.  The  NBC  CREST  prototype  Version  2.1  was  developed  in  conjunction  with  the  Army  Office  of  the  Surgeon 
General. 
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Other  Special  Events 


DATE/TIME 

EVENT 

COORDINATOR 

ROOM 

Tuesday 

18  June 
0715-0815 

Working  and  Composite  Group  Warm-up 

Mr.  Jack  Keane 

Bell  Hall 
Marshall 
Auditorium 

1 

Tuesday 

18  June 
1530-1700 

Sponsors’  Job  Fair  for  Civilian  OR  Analysts 

Ms.  Corinne 
Wallshein 

Bell  Hall 
Trophy  Loun 

ge 

Wednesday 

19  June 

0700  -  0800 

Town  Hall  Breakfast  Meeting 
(WG  &  CG  Chairs  ONLY) 

Mr.  Jack  Keane 

Hearth  Room, 

FCC 

PHALANX  Editors’  Breakfast  Meeting 

Mr.  Paul  West 

Centennial  Room, 
FCC 

Military  Operations  Research  Journal  Editors' 
Breakfast  Meeting 

Dr.  Dick  Deckro 

Porch  Room,  FCC 

Wednesday 

19  June 
1230-1430 

Sponsors’  Job  Fair  for  Civilian  OR  Analysts 

Ms.  Corinne 
Wallshein 

Bell  Hall 

Trophy  Lounge 

Thursday 

20  June 
0715-0815 

Test  &  Evaluation,  Modeling  &  Simulation  &  W&A 
Workshop  Organizing  Committee  Meeting 

Ms.  Anne  Patenaude 

Bell  Hall  CR 

:6 

Thursday 

20  June 
0830-1030 

Sponsors’  Job  Fair  for  Civilian  OR  Analysts 

Ms.  Corinne 
Wallshein 

Bell  Hall 
Trophy  Loun 

-1 

Thursday 

20  June 
1030-1145 

71st  MORSS  Program  Committee  Meeting 

Mr.  Patrick  McKenna 

GIF,  Room  253D 

Thursday 

20  June 
1530-1700 

Working  and  Composite  Group  Wrap-Up 

Mr.  Jack  Keane 

Bell  Hall  CR 
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General  Information 


►  ►  ►  ►  General  Information  ^  ^ 


►  MORS  Office  at  Fort  Leavenworth 

MORS  office  at  Fort  Leavenworth  will  be  located  in  Classroom  4A,  Bell  Hall,  USACGSC,  and  will  open  on  Thursday 
and  Friday,  13  and  14  June,  and  Monday,  17  June,  0830-1700;  on  18,  19,  20  June,  0700-1730. 


Phone  numbers  at  FLVN: 


913-684-7721 

FAX 

913-684-7723 

913-684-7722 

DSN 

552- 

PHONE  ROOM 

Phones  with  DSN  lines  and  credit  card  capability  will  be 
available  in  Bell  Hall,  Classroom  4B. 

►  Bus  Transportation 

Buses  will  transport  attendees  to  Fort  Leavenworth  from  the  hotels  listed  below  in  the  morning  and  back  after  the  sessions 
each  day  and  the  mixer  on  Tuesday.  Buses  will  also  transport  attendees  from  these  hotels  to  and  from  the  Wednesday  evening 
at  the  Steamboat  Arabia  Museum  Dinner.  A  detailed  bus  schedule  is  in  the  green  section  of  this  Final  Program.  Please  note: 
Due  to  increased  post  security,  we  strongly  encourage  all  attendees  to  use  the  MORS  buses. 

►  MORSS  Hotels 


The  following  are  the  hotels  to  and  from  which  MORS  will  provide  bus  service.  Please  note  that  the  MORS  HQ  Hotel  is  the 
AmeriSuites. 


Hotel 

Phone 

#  of  Rooms 

Rate 

MORS  HQ  Hotel 

AmeriSuites 

7600  NW  97th  Terrace,  Kansas  City,  MO  64153 

816-891-0871 

125 

$85  +  tax 

MainStay  Suites 

9701  North  Shannon  Avenue,  Kansas  City,  MO  64153-1828 

816-891-8500 

20 

$59.95  +  tax 

Hilton  KCI 

8801  NW  112th  Street,  Kansas  City,  MO  64153 

816-891-8900 

75 

$85/95  +  tax 

Radisson  Hotel 

11828  NW  Plaza  Circle,  Kansas  City,  MO  64153 

816464-2423 

100 

$85  +  tax 

Holiday  Inn  KCI 

11832  Plaza  Circle,  Kansas  City,  MO  64153 

816464-2345 

85 

$85  +  tax 

Fairfield  Inn  KCI 

11820  NW  Plaza  Circle,  Kansas  City,  MO  64153 

816464-2424 

85 

$72  +  tax 

Kansas  City  Airport  Marriott 

775  Brasilia  Avenue,  Kansas  City,  MO  64153 

816464-2200 

50 

$85/85  + 
12.35  tax 

►  MORSS  Wednesday  Night  Event 

The  Wednesday  night  dinner  activity  will  feature  both  a  remarkable  venue  and  world  famous  cuisine  -  Kansas  City  style 
barbeque.  The  venue  will  be  the  Steamboat  Arabia  Museum,  which  is  located  in  the  Kansas  City,  MO  City  Market  Area. 
The  address  is  400  Grand  Boulevard  between  5th  and  3rd  Streets.  The  phone  number  is  816-471-1856.  Dinner  is  being  catered 
by  Kansas  City  Masterpiece  Barbeque  and  Grill!  Bus  transportation  will  be  available  to  and  from  the  dinner. 
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General  Information 


►  MORSS  Registration 

Regular  Registration  -  Regular  registration  will  take  place  on  Tuesday,  18  June  2002,  0700-0900  on  the  Porch  of  Bell 
Hall. 

1 .  Be  sure  to  bring  your  yellow  two-part  Invitation  with  you  to  registration.  The  top  part,  Copy  1  Invitation/  Receipt  is 
your  copy.  The  bottom  part.  Copy  2,  is  MORS'  copy.  Please  sign  in  on  the  bottom  line  before  you  arrive  at 
registration. 

2.  At  registration,  you  will  be  directed  to  the  proper  alphabetical  line  to  register.  The  registrar  will  compare  the  MORS 
ID  card  with  your  features,  and  will  ask  for  another  picture  ID.  If  all  is  in  order,  the  registrar  will  keep  Copy  2  and 
give  you  a  package  containing: 

a.  Badge  Holder  with  Name  Badge  and  MORS  ID  Card  (or  place  for  active  duty  ID  Card). 

b.  MORSS  Final  Program  and  Book  of  Abstracts 

c.  Membership  Card 

d.  Ticket(s)  for  any  meals  purchased 

e.  Neck  Chain 

f.  MORSS  Quick  Reference  Program  Schedule  (QRPS) 

Those  arriving  after  0900  on  Tuesday  morning  will  register  in  the  MORS  Office  (Bell  Hall,  Room  4A)  at  Fort  Leavenworth. 

Government  Quarters  -  Government  quarters  and  messing  WILL  NOT  BE  AVAILABLE.  To  accommodate  this 
constraint,  orders  should  specify  Kansas  City,  Missouri  as  the  TDY  destination,  with  the  following  disclaimer  provided  in 
Block  16  of  DD  Form  1610.  “Government  mess/lodging  are  unavailable .  Use  of  government  facilities  would 
adversely  affect  the  performance  of  the  assigned  mission. 99 

Statements  of  Non-availability  -  Statements  of  Non-availability  will  NOT  be  provided;  however,  a  non-availability 
number  will  be  provided  to  attendees  during  registration  so  that  it  may  be  cited  when  applying  for  reimbursement  after  the 
symposium. 

Lost/Found  -  The  Lost  and  Found  will  be  in  the  MORS  office  at  the  host  facility.  Items  not  claimed  at  the  end  of  the 
Symposium  will  be  left  with  the  host  facility. 

Weather  -  The  weather  in  June  should  be  sunny  and  in  the  80’s  during  the  day. 

Uniform  -  If  you  are  a  military  officer  on  active  duty  and  would  like  to  use  your  green  active  duty  military  ID  card  for 
photo  identification  at  the  symposium  you  MUST  be  in  uniform.  If  you  would  prefer  to  use  civilian  attire  then  you  must  be 
issued  a  MORS  ID  card.  Appropriate  civilian  attire  is  business  casual. 

Mixer  -  There  will  be  an  informal  mixer  at  the  Frontier  Army  Museum  on  Tuesday  evening,  18  June,  from  1715-1900. 
There  will  be  a  cash  bar.  Bus  transportation  will  be  provided  back  to  the  hotels  before  and  after  the  mixer. 

Lunches  -  There  will  be  a  lunch  buffet  at  the  Frontier  Conference  Center.  Tickets  are  $7.00  per  day  and  can  be  purchased 
in  the  MORS  Office.  Transportation  will  be  provided  to  and  from  this  facility.  The  following  facilities  are  within  walking 
distance:  The  General  Instruction  Facility  (GIF)  Cafeteria,  Bell  Hall  Cafeteria,  Trails  West  Golf  Course  Snack  Bar,  Burger 
King,  and  the  Bowling  Alley  Snack  Bar.  Many  restaurants  and  fast  food  facilities  are  located  outside  the  main  gate. 

Box  lunches  -  Box  lunches  are  $8.00  each  per  day.  Please  purchase  tickets  in  the  MORS  Office. 

Coffee  -  Coffee  and  snacks  will  be  provided  on  Tuesday,  Wednesday  and  Thursday  without  charge  at  the  following  times: 

0700-0830  &  i  —  1500-1530 

Designated  Smoking  Areas  -  Smoking  is  NOT  permitted  in  any  building  at  Fort  Leavenworth.  Designated  smoking 
areas  will  be  posted. 

Limo  Service  from  the  Airport  -  For  limousine  service  to  and  from  Kansas  City  International  Airport  (KCI)  you  can  call 
#/  Limo  Service.  Reservations:  913-208-6811,  Email:  namal@swbell.net.  Website:  www.l-limo.com.  Reservations  may  be 
booked  up  to  one  year  in  advance.  AmEx,  MC/VISA  and  cash  accepted. 
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Security  Matters 

►  ►  MORSS  Security  Matters i  i 

All  attendees  and  speakers  at  the  70th  MORSS  are  US  Nationals 
All  have  SECRET  clearances  and  need-to-know  certified  by  competent  authority. 

Attendees  are  reminded  of  the  necessity  for  continuing  attention  to  security  precautions.  While  every  effort  will  be  made 
to  provide  a  secure  facility  for  the  meeting  and  to  insure  that  attendees  are  properly  identified,  cleared,  and  in  possession  of 
the  required  need-to-know,  all  are  reminded  that  the  responsibility  for  the  unauthorized  disclosure,  particularly  with  regard  to 
conversations,  rests  with  the  individual  attendee.  Attendees  are  requested  to  keep  in  mind  the  following  important  points: 

1 .  Be  careful  WHERE  you  make  classified  disclosures.  Do  not  extend  classified  discussion  to  hotels,  restaurants,  officers' 
clubs,  or  other  places  in  which  you  are  unable  to  positively  identify  all  within  hearing  distance  and  be  reassured  of  the 
nonexistence  of  eavesdropping  devices. 

2.  Be  careful  TO  WHOM  you  make  classified  disclosures.  You  should  assure  yourself  that  the  people  to  whom  you  are 
talking  are  indeed  registrants  at  the  70th  MORSS.  You  are  advised  that  a  uniformed  or  civilian  person  located  away 
from  the  restricted  area  of  the  meeting  and  not  personally  recognized  as  a  registrant  does  not  have  authorized  access  to 
classified  information,  regardless  of  his  possession  of  a  MORS  name  badge. 

3.  The  attention  of  non-government  attendees  is  invited  to  the  National  Industrial  Security  Program  Operating  Manual 
(NISPOM),  Chapter  5,  Section  5,  with  regard  to  disclosure  authorizations. 

4.  Attendees  are  advised  that  possession  of  photographic,  audio  recording  or  electronic  transmitting  devices  is  not 
authorized  in  the  meeting  spaces  of  the  70th  MORSS. 

Admission  Policy 

Admission  to  the  secure  area  of  the  meeting  is  limited  to  holders  of  current  printed  invitations  properly  authenticated  and 
issued  by  the  MORS  office  to  the  named  individual  for  his  attendance  at  the  70th  MORSS. 

Persons  who  enter  or  attempt  to  enter  the  secure  area  of  the  meeting  without  proper  invitation  and  persons  who  aid, 
encourage,  or  willfully  permit  improperly  authorized  persons  to  enter  the  secure  area  of  the  meeting  are  liable  for  citation  for 
security  violation. 

Invitations 

The  only  admissible  invitation  is  the  official  70th  MORSS  Invitation  issued  by  the  MORS  Office.  Other  invitations, 
including  official  invitations  for  earlier  MORSS,  are  inadmissible.  There  is  no  provision  for  one-session-only  invitations  and 
MORS  has  no  obligation  to  issue  invitations  after  the  announced  deadline  or  to  work  out  invitations  for  persons  who  arrive 
uninvited  at  the  meeting.  Invitations  must  be  brought  to  the  meeting.  They  are  required  for  registration. 

Restricted  Meeting  Areas 

Those  portions  of  the  meeting  area  lying  inside  of  the  posted  guards  are  designated  restricted  meeting  areas  for  the  70th 
MORSS.  All  classified  presentations  and  discussions  in  connection  with  the  MORSS  program  are  to  be  conducted  inside 
this  area.  Only  the  following  persons  are  permitted  access  to  MORS  meeting  areas: 

•  Officially  invited  70th  MORSS  attendees  with  appropriate  MORS-issued  name  badges  and  approved  ID  cards; 

•  MORS  staff  and  service  personnel  with  appropriate  MORS-issued  name  badges  and  approved  ID  cards; 

•  Members  of  the  70th  MORSS  guard  force; 

•  Officials  representing  the  host  command  on  official  business. 

Entry  to  the  Meeting  Areas 

Entry  to  the  restricted  meeting  areas  will  be  regulated  by  the  guard  force  and  working  group  chairs  and  cochairs. 

At  each  entry  to  the  meeting  area,  each  attendee  will  be  required  to  stop  long  enough  to  show  his  properly  validated  70th 
MORSS  name  badge  and  his  identification  and  to  be  recognized  by  the  guards.  The  name  badge  and  ID  card  should  be 
displayed  at  all  times  within  the  restricted  meeting  area.  The  guards  or  working  group  chairs  and  co-chairs  will  check  the 
following  before  admitting  an  attendee  to  the  classified  area: 

•  The  validity  of  the  ID  card 

•  The  validity  of  the  name  badge 

•  The  correspondence  of  face  and  ID  picture 

•  The  correspondence  of  name  on  badge  and  ID  card. 

So  that  the  ID  check  can  be  accomplished  quickly,  name  badges  and  ID  cards  must  be  displayed  together  in  the  MORS 
name  badge  holder. 
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Security  Matters 


Picture  ID  Cards 

All  attendees  in  the  restricted  meeting  areas  are  required  to  display  their  ID  cards  in  the  MORS  badge  holders  along  with 
their  name  badges.  Only  two  types  of  ID  cards  are  permissible:  the  active  duty  military  ID  card  (military  officers  on  active 
duty  MUST  be  in  uniform  to  use  their  military  ID  card)  and  the  ID  card  issued  by  MORS.  The  MORS-issued  ID  cards  will  be 
delivered  to  the  attendees  when  they  register.  It  is  important  that  the  attendee  return  the  card  to  the  MORS  office  when 
leaving  the  meeting.  Otherwise,  the  attendee  will  have  to  obtain  a  new  ID  card  for  subsequent  MORSS. 

MORS  Name  Badges 

A  MORS  name  badge  is  issued  to  each  properly  registered  attendee,  along  with  a  plastic  pouch  for  its  display.  Attendees 
should  take  care  that  the  badge  is  not  lost  or  loaned  during  the  meeting,  as  these  are  avenues  for  improper  entry  and  security 
violations.  Badges  should  not  be  changed,  corrected,  or  altered  in  any  way.  If  such  action  is  necessary,  a  member  of  the 
MORS  staff  will  issue  and  authenticate  a  new  badge. 

Note  Taking 

Classified  presentations  shall  be  delivered  orally  and/or  visually.  Classified  documents  shall  not  be  distributed  and 
classified  note  taking  and  electronic  recordings  shall  not  be  permitted  by  attendees  during  classified  presentations. 

Classified  Matter— Transmittal 

For  those  who  sent  their  classified  matter  ahead  of  time  to  the  following  address: 

Director  TRAC 

Attn:  MORSS  (Natalie  Kelly) 

255  Sedgwick  Avenue 

Fort  Leavenworth,  KS  66027-2345 

You  may  retrieve  your  package  from  the  MORS  Office,  when  you  arrive  at  the  Symposium,  after  1000  on  Tuesday,  18 
June  2002.  Please  note:  Capability  to  perform  major  reproduction  of  your  materials  once  you  arrive  at  MORSS  WELL  NOT 
be  provided. 

When  no  longer  needed  for  the  Symposium,  attendees  may  bring  their  classified  material  to  the  MORS  office  to  be 
wrapped  for  hand  carry  or  transmittal  to  their  parent  activity.  The  attendee  is  responsible  for  providing  a  letter  of 
transmittal  to  be  included  in  the  package.  The  meeting  security  staff  will  be  responsible  for  proper  wrapping  and  marking 
of  inner  and  outer  envelopes  in  accordance  with  Navy  security  regulations.  The  address  for  classified  mail  shown  on  the 
attendee's  personal  security  voucher  will  be  used  for  mailing  purposes.  MORS  will  accept  responsibility  for  mailing  a 
properly  wrapped  and  sealed  package  by  registered  mail  and  will  provide  the  attendee  with  a  receipt  for  the  sealed  package. 
Because  of  congestion,  MORS  staff  will  not  be  able  to  wrap  packages  during  the  breaks  between  sessions. 

Classified  Material — Overnight  Storage 

The  MORS  office  will  accept  (until  15  minutes  after  the  end  of  the  last  session)  and  safeguard  (for  the  meeting  duration) 
classified  material  to  the  level  of  SECRET.  Material  will  be  accepted  as  a  package  rather  than  loose.  Receipts  must  be 
presented  on  recovery  of  material  by  its  holder.  The  MORS  office  staff  is  cleared  to  the  SECRET  level. 

Classified  Disclosure 

Persons  participating  in  the  discussions  at  the  70th  MORSS  have  been  granted  limited  disclosure  authorization  via  their 
personal  security  vouchers  for  the  70th  MORSS.  It  is  the  individual  responsibility  of  each  participant  to  find  out  in  advance, 
from  his  certifying  official,  the  limits  to  his  own  classified  disclosures  and  to  stay  within  those  limits  at  the  symposium. 

A  written  MORS  Disclosure  Form  #712  A/B  is  required  for  all  papers  and  presentations  (government  and 
contractor).  All  MORS  Disclosure  Forms  #712  A/B  must  be  forwarded  to  the  MORS  Security  Manager  before  the 
presentation  is  given.  If  the  disclosure  form  is  not  received  by  MORS  prior  to  the  symposium,  the  presentation  will  be 
canceled.  Request  additional  disclosure  forms  from  the  MORS  office  or  download  them  from  www.mors.org. 
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Society  Organization 

►  ►  ►  Society  Organization i  i  i 


OFFICERS 


President 

Dr.  Thomas  L.  Allen*,  IDA 
President-Elect 

Edward  A.  Smyth*,  Johns  Hopkins  University/APL 
VP  for  Finance  and  Management 

Dr.  Richard  E.  Hayes,  Evidence  Based  Research,  Inc. 
VP  for  Meeting  Operations 

Anne  Patenaude,  Northrop  Grumman  IT 
VP  for  Professional  Affairs 

LTC  Willie  J.  McFadden  II*,  USMA 


Secretary 

Lt  Col  Suzanne  Beers*,  SWC/AEA 
Immediate  Past  President 

Dr.  Roy  E.  Rice*,  Teledyne  Brown  Engineering 
Executive  Vice  President 
Brian  D.  Engler*.  MORS 
VP  for  Administration 

Natalie  Strawn  Kelly,  MORS 

*Member  of  the  Executive  Council 


COL  Jeffrey  A.  Appleget,  TRAC,  WSMR 
Donald  R.  Bates,  OSD(PA&E) 

Denis  T.  Clements,  GRCI 
Lawrence  L.  Dick,  Office  21  Solutions,  Inc. 
Robert  W.  Eberth,  Sanderling  Research  Corp. 
W.  Dean  Free,  Dean  Free  and  Assoc. 

Michael  Garrambone,  Veridian 
Priscilla  Glasow,  MITRE 
Susan  M.  Iwanski,  SPA,  Inc. 

John  F.  Keane,  Johns  Hopkins  University/APL 
Michael  Leonard,  IDA 


OTHER  DIRECTORS 

Dr.  Andrew  G.  Loerch,  George  Mason  University 
John  A.  Marriott,  Litton/TASC 
COL  Mike  McGinnis,  USMA 
Lana  E.  McGlynn,  ODUSA  (OR) 

Dr.  Steven  E.  Pilnick,  NPS 
Prof  Richard  E.  Rosenthal,  NPS 
Gabriel  Rouquie,  Jr.,  Northrop  Grumman  IT 
LTC  George  F.  Stone  III,  OSD(PA&E) 

Charles  B.  Taylor,  Joint  C4ISR  Decision  Support  Ctr. 

Lt  Col  Kirk  A.  Yost,  Office  Under  Secretary  of  Defense  for  Policy 


ADVISORY  DIRECTORS 

Mary  T.  Bonnet,  AFSAA/SAJ  Dr.  Cyrus  J.  Staniec,  Northrop  Grumman  IT 

Helaine  G.  Elderkin,  FS,  Computer  Sciences  Corp  COL  Richard  I.  Wiles,  FS,  Executive  VP  Emeritus 

Kenneth  C.  Konwin,  BAH,  Inc. 


MORS  SPONSORS 


Walter  W.  Hollis,  FS 

Deputy  Under  Secretary  of  the  Army 

Operations  Research 

RADM  Lewis  W.  Crenshaw,  Jr.,  USN 
Director,  Assessment  Division 
Office  Chief  of  Naval  Operations  (N81) 

Dr.  Jacqueline  R.  Henningsen,  FS 

Director,  Air  Force  Studies  and  Analyses  Agency 


LtGen  Edward  Hanlon,  Jr.,  USMC 
Commanding  General 

Marine  Corps  Combat  Development  Command 

Lt  Gen  James  E.  Cartwright,  USMC 

Director  of  Force  Structure,  Resources  and  Assessment 

The  Joint  Staff,  J-8 

Eric  J.  Coulter 

Director,  Office  of  the  Secretary  of  Defense 
Program  Analysis  &  Evaluation 


SPONSORS  REPRESENTATIVES 


COL  Hda  Generazio 
DUSA  (OR) 
Gregory  Melcher 
N81D 

Royce  Reiss 
AFSAA/SAA 


Col  Philip  J.  Exner 
MCCDC 
Peter  By  me 
The  Joint  Staff,  J-8 
Ronald  Moore 
OSD  (PA&E) 


MORS  STAFF 


Brian  D.  Engler,  Executive  Vice  President 

Natalie  Strawn  Kelly,  Vice  President  for  Administration 

Cynthia  L.  Kee,  Administrator 

Corrina  Ross-Witkowski,  Communications  Manager 

Jarvey  Nelson,  Administrative  Assistant 


COL  Richard  I.  Wiles,  FS,  Executive  Vice  President  Emeritus 
Helaine  G.  Elderkin,  FS,  Counsel 

Dr.  Richard  F.  Deckro,  Editor,  Military  Operations  Research 
Paul  D.  West,  Editor,  PHALANX 
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Society  Organization 


►  ►  ►  70th  MORSS  Program  Staff  <  <  < 


Program  Chair:  Dr.  Steve  Pilnick  -  831-656-2283 


Assistant  Program  Chair: 

CDR  Suzanne  Scheller 
202-685-5370 

Program  Chair  Advisor: 

COL  Mike  McGinnis 
914-938-2701 

Deputy  Chairs: 

Logistics  -  COL  Bill  Adams,  913-684-6861 
Operations  -  Pat  McKenna,  402-294-1654 
IT-  Lee  Dick,  703-697-0182 


Coordinators: 

Plenary/Special  Sessions 
Sue  Iwanski,  703-578-5636 
Bob  Clemence,  703-413-1100 

USACAC  Site 
Pat  Smock,  913-684-9155 
Rumi  Dodson,  913-684-9186 

Working  and  Composite  Groups 
Jack  Keane,  240-228-8886 
Don  Bates,  703-697-0802 
LTC  George  Stone,  703-707-7189 
Kayte  Sullivan,  240-228-4834 
Mike  Leonard,  703-845-2255 


Poster  Presentations 
Sherry  Barnes,  540-653-3929 

Demonstrations 
Bill  Dunn,  703-575-2800 

Tutorials 

Dr.  Andy  Loerch,  703-993-1657 
Prize  Papers 

Denis  Clements,  703-506-5985 

Sponsors’  Job  Fair 
Corinne  Wallshein,  703-588-8759 

VIP 

USACAC:  June  Fowler,  913-684-6862 
DC:  Patricia  Hickman,  757-764-5757 

Junior/Senior  Analyst 
Jay  Wilmeth,  703-312-2366 

Guest  Program  Coordinators 
June  Fowler,  913-684-5132 
MSG  LaWanda  Cooper 

MORS  Staff: 

Brian  D.  Engler,  Executive  Vice  President 
Natalie  Strawn  Kelly,  Vice  President  Administration 
Cynthia  L.  Kee,  Administrator 
Corrina  Ross-Witkowski,  Communications  Manager 
Jarvey  Nelson,  Administrative  Assistant  -  703-933-9070 


MORS  Purposes  &  Objectives 


The  purpose  of  the  Military  Operations  Research  Society  is  to  enhance  the  quality  and  effectiveness  of  classified  and  unclassified  military 
operations  research.  To  accomplish  this  purpose,  the  Society  provides  media  for  professional  exchange  and  peer  criticism  among  students, 
theoreticians,  practitioners,  and  users  of  military  operations  research.  These  media  consist  primarily  of  the  traditional  annual  MORS  symposia 
(classified),  their  published  proceedings,  special  mini-symposia,  workshops,  colloquia  and  special  purpose  monographs.  The  forum  provided 
by  these  media  is  directed  to  display  the  state  of  the  art,  to  encourage  consistent  professional  quality,  to  stimulate  communication  and 
interaction  between  practitioners  and  users,  and  to  foster  the  interest  and  development  of  students  of  operations  research.  In  performing  its 
function,  the  Military  Operations  Research  Society  does  not  make  or  advocate  official  policy,  nor  does  it  attempt  to  influence  the  formulation  of 
policy.  Matters  discussed  or  statements  made  during  the  course  of  its  meetings  or  printed  in  its  publications  represent  the  positions  of  the 
individual  participants  and  authors  and  not  of  the  Society. 


The  Military  Operations  Research  Society  is  operated  by  a  Board  of  Directors  consisting  of  30  members,  28  of  whom  are  elected  by  vote 
of  the  Board  to  serve  a  term  of  four  years.  The  persons  nominated  for  the  Board  generally  are  individuals  who  have  attained  recognition  and 
prominence  in  the  field  of  military  operations  research  and  who  have  demonstrated  an  active  interest  in  the  programs  and  activities  of  MORS. 
The  remaining  two  members  of  the  Board  of  Director’s  are  the  Past  President  who  serves  by  right  and  the  Executive  Vice  President  who 
serves  as  a  consequence  of  his  position.  A  limited  number  of  Advisory  Directors  are  appointed  from  time  to  time,  for  a  1-year  term,  to  perform 
some  particular  function.  In  addition  to  the  members,  the  Society  maintains  a  general  distribution  list  of  others  to  whom  announcements, 
newsletters,  and  information  are  routinely  sent. 


The  MORS  Board  of  Directors  wants  to  make  the  meetings  and  other  operations  of  the  Society  as  responsive  as  possible,  both  to  the 
needs  of  the  times  and  the  desires  of  the  members.  Consequently,  attendees  are  invited  to  communicate  their  relevant  ideas  and  thoughts  to 
any  Officer  or  other  Director  or  to  the  Society  in  writing.  Where  practicable,  your  communications  will  be  duplicated  and  furnished  to  the  MORS 
Board  Members  and  Program  Chairs  for  guidance  in  respect  to  future  plans  and  operations. 

The  following  are  particularly  encouraged: 


•  Offers  of  help  in  future  symposium  programs  and  working  groups. 

•  Proposals  for  establishing  new  working  groups. 

•  Suggestions  for  future  keynote  speakers,  meeting  themes,  meeting  sites,  improvements  in  logistics. 

•  Criticism  of  current  operations  or  programs. 

The  Society  will  consider  all  comments,  suggestions  and  proposals. 
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lild/15 


2002  RIST  PRIZE 

CALL  FOR  PAPERS 


MORS  offers  two  prizes  for  best  papers  -  the  Barchi  Prize  and  the  Rist  Prize.  The  Rist  Prize  will  be  awarded  to  the 
best  paper  in  military  operations  research  submitted  in  response  to  this  Call  for  Papers.  The  Barchi  Prize  will  be 
awarded  to  the  best  paper  from  the  entire  70th  MORS  Symposium,  including  Working  Groups,  Composite  Groups,  and 
Special  Sessions. 

David  RiSt  Prize:  Papers  submitted  in  response  to  this  call  will  be  eligible  for  consideration  for  the  Rist  Prize. 
The  committee  will  select  the  prize-winning  paper  from  those  submitted  and  award  the  prize  at  the  7 1st  MORSS.  If 
selected,  the  author(s)  will  be  invited  to  present  the  paper  at  the  7 1st  MORSS  and  to  prepare  it  for  publication  in 
the  MORS  journal,  Military  Operations  Research.  The  cash  prize  is  $1000.  To  be  considered,  the  paper: 

❖  Must  be  mailed  to  the  MORS  office  and  postmarked  no  later  than  27  SfiPtSmbST  2002; 

❖  Cannot  be  more  than  10,000  words  OR  40  pages  (including  graphics). 

Please  send  the  original,  three  copies  and  a  soft  copy. 

Richard  H.  Barchi  PriZS:  Author(s)  of  those  papers  selected  as  the  best  from  their  respective  Working  Group 
or  Composite  Group,  and  those  of  the  Special  Sessions  at  the  70th  MORSS  will  be  invited  to  submit  their  paper  for 
consideration  for  the  Barchi  Prize.  The  committee  will  select  the  prize-winning  paper  from  among  those  presented, 
nominated  and  submitted.  The  prize  will  be  presented  at  the  71st  MORSS.  The  cash  prize  is  $1000.  To  be 
considered,  the  paper  must  be  mailed  to  the  MORS  office  and  postmarked  no  later  than  22  N0V6mb8f  2002, 
cannot  be  more  than  10,000  words  OR  40  pages  (including  graphics).  Please  send  the  original,  three  copies  and  a 
soft  copy. 

Prize  Criteria 

The  criteria  for  selection  for  both  prizes  are  valuable  guidelines  for  presentation  and/or  submission  of  any  MORS  paper. 
To  be  eligible  for  either  award,  a  paper  must,  at  a  minimum: 

❖  Be  original  and  a  self-contained  contribution  to  systems  analysis  or  operations  research; 

❖  Demonstrate  an  application  of  analysis  or  methodology,  either  actual  or  prospective; 

❖  Prove  recognizable  new  insight  into  the  problem  or  its  solution;  and 

❖  Not  previously  been  awarded  either  the  Rist  Prize  or  the  Barchi  Prize  (the  same  paper  may  compete  for,  but  cannot 
win,  both  prizes.) 

Eligible  papers  are  judged  according  to  the  following  criteria: 

Professional  Quality 

❖  Problem  definition  *♦* 

❖  Citation  of  related  work  '!• 

❖  Description  of  approach  *1* 

❖  Statement  of  assumptions  *♦* 

❖  Explanation  of  methodology 

Contribution  to  Military  Operations  Research 

❖  Importance  of  problem 

❖  Contribution  to  insight  or  solution  of  the  problem  ♦> 


Analysis  of  data  and  sources 
Sensitivity  of  analyses  (where  appropriate) 
Logical  development  of  analysis  and  conclusions 
Summary  of  presentation  and  results 


Power  of  generality  of  the  result 
Originality  and  innovation 
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70th  MORSS  Composite  Group  &  Working  Group  Chairs 


Military  Operations  Research  at  the  Next  Frontier 


WG/CG  Coordinator: 

Jack  Keane 

240-228-8886 

jack.keane@jhuapl.edu 

Deputy  Coordinators: 

Don  Bates 

703-697-0802 

donald.bates@osd.pentagon.mil 

George  Stone 

703-696-9490 

george.stone@osd.pentagon.mil 

CG  A  Strategic  and  Defense  -  Chair: 

Julia  Burr 

703-845-2391 

jburr@ida.org 

WG  1 

Strategic  Operations 

Doug  Anson 

505-667-0965 

anson@lanl.gov 

WG  2 

NBC  Defense 

Jon  Davis 

540-653-5950 

davisje@nswc.navy.mil 

WG  3 

Arms  Control  and  Proliferation 

Tom  Mcllvain 

703-824-3148 

tmcilvain@acsdefense-dc.com 

WG  4 

Air  and  Missile  Defense 

Bob  Strider 

256-955-5981 

striderb@smdc.army.mil 

CG  B  Space/C4ISR  -  Chair: 

Ted  Bennett 

228-688-4148 

bennettt@navo.navy.mil 

i 

WG  5 

Operational  Contribution  of  Space  Systems 

Steve  Friedman 

937-476-2509 

sfriedman@dytn.veridian.con 

WG  6 

C4ISR 

Jon  Grossman 

310-393-0411  x7622 

jon  grossman@rand.org 

WG  7 

OR  and  Intel  Analysis 

Mark  Youngren 

703-883-6446 

youngren@mitre.org 

WG  8 

IO/IW 

Dick  Deckro 

937-255-6565  x4325 

richard.deckro@afit.edu 

WG  9 

EW  and  Countermeasures 

Mike  Gauble 

856-722-3774 

Michael.f.gauble@lmco.com 

WG  10 

Unmanned  Systems 

James  R  Johnson 

850-882-7652 

james.johnson4@eglin.af.mil 

WG  11 

Military  Environmental  Factors 

Gary  McWilliams 

301-394-2053 

gmcwilliams@arl.army.mil 

CG  C  Joint  Warfare  -  Chair: 

Robert  C  Holcomb 

703-578-2816 

rholcomb@ida.org 

WG  12 

Land  and  Expeditionary  Warfare 

Steve  Riese 

913-684-9119 

rieses@trac.army.mil 

WG  13 

Littoral  Warfare  and  Regional  Sea  Control 

Terry  McKeamey 

619-692-0558 

mckeamey@nosc.mil 

WG  14 

Power  Projection 

Trena  Lilly 

240-228-7142 

trena.lilly@jhuapl.edu 

WG  15 

Air  Power  and  Combat  ID 

Debbie  Hall 

937-476-2533 

debbie.hail@veridian.com 

WG  16 

Special  Operations  and  OOTW 

COL  Tim  Hope 

703-806-5617 

hope@caa.army.mil 

WG  17 

Joint  Campaign  Analysis 

LTC  Barry  Bazemore 

913-684-9187 

bazemoreb@trac.army.mil 

CG  D  Resources  -  Chair: 

Herb  Shukiar 

310-393-0411  x7175 

herb@rand.org 

WG  18 

Mobility  and  Transportation  of  Forces 

David  Lyle 

334-416-4526 

david.lyle@maxwell.af.mil 

WG  19 

Logistics,  Reliability  and  Maintainability 

Jane  Krolewski 

410-278-465 7 

hock@amsaa.army.mil 

WG  20 

Manpower  and  Personnel 

Major  Mike  Kwinn 

914-938-5941 

fm9536@exmail.usma.army.i 

mil 

CG  E  Readiness/Training  -  Chair: 

Lt  Col  Greg  McIntyre 

703-696-9490 

greg.mcintyre@osd.pentagon.mil 

WG  21 

Readiness 

Dan  Cuda 

703-578-2770 

dcuda@ida.org 

WG  22 

Analytic  Support  to  Training 

Lt  Col  Joe  Smith 

703-784-6022 

smithjg@mccdc.usmc.mil 

WG  23 

Battlefld  Perf,  Casualty  Sustmt  &  Med  Pin 

Jim  Mantock 

972-437-5001 

jmantock@scenpro.com 

CG  F  Acquisition  -  Chair: 

John  Ferguson 

703-312-2364 

jferguson@logicon.com 

WG  24 

Measures  of  Effectiveness 

MAJ  Barry  Ezell 

757-467-1695 

bcezell@aol.com 

WG  25 

Test  and  Evaluation 

Charles  Walters 

703-578-6122 

charies.walters@osd.mil 

WG  26 

Analysis  of  Alternatives 

Bruce  Wyman 

703-971-3103  x162 

bwyman@northrupgruman.com 

WG  27 

Cost  Analysis 

William  Kroshl 

240-228-4870 

william.kroshl@jhuapl.edu 

WG  28 

Decision  Analysis 

Gwen  F  Delano 

540-653-5047 

gdelano@iwac.osis.gov 

CG  G  Advances  in  Military  OR  -  Chair: 

Hugh  Dempsey 

757-788-5822 

dempseyh@monroe.arrr 

iy.mil 

WG  29 

Modeling,  Simulation  and  Wargaming 

Jeff  Dubois 

937-476-2566 

jdubois@dytn.veridian.com 

WG  30 

Revolution  in  Military  Affairs 

Matt  Caffrey 

334-953-6161/2526 

matthew.caffrey@maxwell.af 

.mil 

WG  31 

Computing  Advances  in  Military  OR 

Robert  L  Albright 

573-596-0131  x35232 

albrightr@wood.army.mil 

WG  32 

Social  Science  Methods 

John  Warner 

520r538-4704 

john.wamer@hua.army.mil 

WG  PI 

Warfighting  Experimentation 

Lauran  Winter 

757-836-2858 

winterl@je.jfcom.mil 
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70th  MORSS 

Special  Sessions  and  Tutorials  Room  Assignments 
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70lh  MORSS  Bus  Schedule 

Buses  are  provided  by  Easton  Bus  Service,  Inc.  and  will  be  marked  for  MORS 

TUESDAY,  18  JUNE 

_ 

|  DEPARTURES!  FROM  HOTELS1  TO  BELL  HALL  T  6:00  &  7:30  AM  | 

|  (Registration  is  at  Bell  Hall  7:00-8:30  AM;  Plenary  starts  at  8:30) 



|  SHUTTLES  between  Bell  Hall  and  Frontier  Conference  Center  for  Solarium  buffet  1 1 :45  AM-1 :30  PM  I 

1 . . . . . . . .  .  if 

z^ 

|  BUSES  |  FROM  BELL  HALL  TO  HOTELS1  5:15-7:15  PM  | 

1  (Transportation  available  before,  during  and  after  Frontier  Army  Museum  Mixer) 

1 

WEDNESDAY,  19  JUNE 

1  . . . . .    

— 

DEPARTURES!  FROM  HOTELS1  |  TO  BELL  HALL  T  6:00  &  7:30  AM  1 

I  (Early  Buses  drop  invitees  for  town  Hall  and  Editors’  breakfasts  that  start  at  7:00  at  FCC,  then  go  on  to  Bell  Hall;  Buses  will  pick  up  breakfast 

|  attendees  at  FCC  at  about  8:00;  First  WG/CG  sessions  start  at  8:30) 

1 

|  SHUTTLES  between  Bell  Hall  and  Frontier  Conference  Center  for  Solarium  buffet  ]  1 1 :45  AM-1 :30  PM  | 

BUSES  FROM  BELL  HALL  TO  HOTELS1 

5:15  PM 

(Departure  in  time  for  bus  service  to  Steamboat  Arabia  Museum  Dinner) 

BUSES  i  FROM  HOTELS1  ]  TO  Steamboat  Arabia  Museum 

6:00  PM 

(Dinner  begins  at  6:30) 

1  BUSES  i  F/?0/lf  Steamboat  Arabia  Museum  I  TO  HOTELS1  8:30-10:00  PM  I 

|  (Transportation  available  until  all  are  returned  from  Dinner) 

. 

_ _ _  __ 

trl 

1  THURSDAY,  20  JUNE 

czz  : 

|  DEPARTURES  FROM  HOTELS1  |  TO  BELL  HALL  |  6:00  &  7:30  AM  | 

|  (First  WG  sessions  start  at  8:30) 

z 

1  SHUTTLES  between  Bell  Hall  and  Frontier  Conference  Center  for  Solarium  buffet  11:45  AM-1 :30  PM  1 

l . . . z  . . 

|  Periodic  BUSES  FROM  BELL  HALL  T  TO  HOTELS  &  KCI  Airport  12:15 

-5:15  PM 

|  (Buses  will  leave  Fort  Leavenworth  periodically  throughout  the  afternoon  to  make  a  circuit  of  Hotels1  &  KCI  Airport  as  needed  by  attendees) 

L 

I 

1  Hotels  with  Bus  service  are:  1)  Amerisuites  and  Mainstay  Suites  (129/Exit  10);  2)  Hilton  KCI  (129/Exit  12);  3)  Radisson  Hotel,  Holiday  Inn 
KCI  and  Fairfield  Inn  KCI  (Plaza  Circle— East  of  129/Exit  13);  4)  Kansas  City  Airport  Marriott  (West  of  129/Exit  13). 
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Route  from  KC  Airport  and 
70th  MORSS  Hotels  to  Fort  Leavenworth 


To  St.  Joseph,  MO 
(25  miles) 


AmeriSuites 
(MORS  HQ) 


70th  MORSS  Hotels 

AmeriSuites  (MORS  HQ)  7600  NW  97th  Terrace 

816-891-0871 

MainStay  Suites 

9701  N.  Shannon  Ave 

816-891-8500 

Hilton  KCI 

8801  NW  112th  St 

816-891-8900 

Radisson 

1 1828  NW  Plaza  Circle 

816-464-2423 

Holiday  Inn  KCI 

11832  Plaza  Circle 

816-464-2345 

Fairfield  Inn  KCI 

1 1820  NW  Plaza  Circle 

816-464-2424 

KC  Airport  Marriott 

775  Brasilia  Ave 

816-464-2200 

MainStay 

_ Suites 


Exit  10 


.  Exit  8 
Barry  Rd) 


To  Kansas  City,  MO 
(7  miles) 
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Lunch  on  Ft.  Leavenworth 


Solarium  Buffet  (Frontier  Conference  Center)  multi-course  lunch  buffet 

Bell  Hall  Cafeteria  cafeteria-style,  deli  sandwiches,  pizza,  etc. 

Trails  End  Golf  Course  Snack  Bar  variety,  grilled  orders 

Burger  King 

PX  Mall  (Taco  Bell,  Robin  Hood  Deli,  Anthony’s  Pizza) 

Bowling  Center  Snack  Bar  variety,  grilled  orders 


Restaurants  in  Leavenworth  Area 

Many  of  the  nationally  franchised  “fast-food”  eateries  are  available  in  Leavenworth  -  nearly  all 
are  located  on  the  4th  Street/KS  Highway  7  corridor.  Additional  restaurants  in  the  area  are  listed 
below  (note:  this  partial  listing  does  not  imply  endorsement). 


*America  Bowman  Restaurant 

500  Welt 

Weston,  MO 

816-640-5235 

Applebee’s 

2912  S.  4th  St 

Leavenworth 

758-1010 

♦Avalon  Cafe 

608  Main 

Weston,  MO 

816-640-2835 

♦Fannie’s  (Home  Style  Buffet ) 

600  Prairie  View  Rd 

Platte  City,  MO 

816-431-5675 

High  Noon  Saloon  &  Brewery 

206  Choctaw 

Leavenworth 

682-4976 

Hunan  Chopsticks  (Chinese  Buffet) 

608  Pottawatomie 

Leavenworth 

651-6728 

King  Buffet  (Chinese/Korean) 

201  N.  5th 

Leavenworth 

682-7661 

Korea  House 

749  Shawnee 

Leavenworth 

682-0705 

Mama  Mia's  Italian  Ristorante 

402  S.  20th 

Leavenworth 

682-2131 

New  China  Inn 

3519  S.  4th 

Leavenworth 

651-8088 

Oasis  Cafe  ( Mediterranean ) 

604  Cherokee 

Leavenworth 

772-0888 

♦O'Malley's  1842  Irish  Pub 

500  Welt 

Weston,  MO 

816-640-5235 

Overlook  Restaurant 

720  1st  Terrace 

Lansing 

727-3313 

♦Paolucci's  Restaurant  &  Lounge 

113  S  3d 

Atchison 

367-6105 

♦River  House  Restaurant 

101  Commercial 

Atchison 

367-1010 

Santa  Fe  Depot  Diner 

781  Shawnee 

Leavenworth 

651-6156 

♦Skyview  Restaurant 

504  Grand  Ave 

Leavenworth 

682-2653 

Tenpenny’s 

1701  10th  Ave 

Leavenworth 

651-1010 

The  Tea  Room 

505  Delaware 

Leavenworth 

682-0777 

Towne  Pub 

1001  Ottawa 

Leavenworth 

682-5456 

Up  Above 

800  N  Main 

Lansing 

727-3223 

♦Vineyard  Restaurant 

505  Spring 

Weston 

816-640-5588 

Western  Sizzlin'  Buffet 

5041  S  4th 

Leavenworth 

727-3054 

(*  due  to  distances,  recommended  for  evening  dining;  reservations  recommended) 
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Fort  Leavenworth  Area 
Representative  Dining  &  Lodging 
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—  <6  Brewery 


Limit 


Villager 

Lodge 


Veie  China  Inn 

☆ 


Leavenworth ,  /iC5 


Western  Sizzlin  Country  Buffet 


EconoLodge 


Holiday  Inn 

Express 


I 


☆ 


La  Mesa 


Note:  Leavenworth’s  4th  St 
becomes  Lansing’s  Main  St 
and  then  becomes  KS  Hwy  7 
going  south  toward  Bonner 
Springs,  Olathe,  &  Kansas  City,KS 


Lansing,  KS 


☆ 


Overlook 


To  Kansas  City,  KS 


i 


Steamboat  Arabia  Museum 

Kansas  City,  MO  in  the  City  Market  area 
400  Grand  Blvd  (between  5th  &  3d  streets) 
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1.  Evaluation  of  70th  MORSS 


The  MORS  Board  of  Directors  and  Symposium  Staff  want  to  improve  MORS  Symposia  to  better  respond  to  your 
needs  and  to  improve  the  quality  of  military  operations  research.  Your  evaluation  is  very  important  and  your 
comments  will  be  considered  in  planning  future  events.  Please  complete  this  questionnaire  and  return  it  to  your 
Composite  Group  or  Working  Group  Chair;  the  MORS  Office  in  Bell  Hall  Room  4A  or  mail  it  to  MORS,  1703  N. 
Beauregard  Street,  #450,  Alexandria  VA  22311-1717.  Thank  you. 

Background  Information: 


•  Name  (optional) _ 

•  What  is  your  affiliation? 


Military: 

□ 

USA 

□ 

USN 

□ 

USAF 

□  USMC 

□ 

USCG 

Civilian: 

□ 

USA 

□ 

USN 

□ 

USAF 

□  USMC 

□ 

USCG 

□ 

Other  DoD 

□ 

FFRDC 

□ 

Joint/Unified  Staff/Command 

□ 

Other  Federal  Gov’t 

□ 

Academic 

□ 

Consultant 

□ 

Professional  Services  Finn 

□ 

Manufacturing  Firm 

□ 

Other 

•  Including  this  MORSS,  how  many  MORS  Symposia  have  you  attended? 

•  Please  check  membership  in  other  professional  organizations? 


□  American  Aeronautical  Society  (AAS) 

□  American  Society  of  Naval  Engineers  (ASNE) 

□  Association  of  Old  Crows  (AOC) 

□  American  Institute  for  Aeronautics  and  Astronautics 
(AIAA) 

□  Armed  Forces  Communications  and  Electronics  Assoc 
(AFCEA) 

□  Electronic  Industries  Association  (EIA) 

□  International  Council  on  Systems  Engineering 
(INCOSE) 

Others?  (Please  List ) 


□  Institute  for  Operations  Research  and 
Management  Science  (INFORMS) 

□  International  Test  and  Evaluation  Association  (ITEA) 

□  Military  Applications  Society  (MAS) 

□  National  Defense  Industrial  Association  (NDIA) 

□  The  Society  of  American  Military  Engineers 
(SAME) 

□  Washington  Institute  for  Operations  Research 
and  Management  Science  (WINFORMS) 


Do  you  plan  on  attending  the  71st  MORSS  at  the  MCB,  Quantico,  VA,  10-12  June  2003? 

□  YES  □  Probably  □  50/50  □  Probably  NO  □  NO 

If  no  or  probably  no,  why  not? 

( 

e.  Please  give  your  assessment  of  each  WORKING  GROUP  Session  and  give  your  overall  assessment  of  the  WG  meeting  your 
needs. 


(1)  Mixer 

(2)  Poster  Presentations 

(3)  Guest  Tour 

(4)  Steamboat  Arabia  Museum  Dinner 

(5)  Demonstrations 

(6)  Government  Job  Fair 
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3.  Evaluation  of  70th  MORSS 


Very  Poor 

1 

Poor 

2 

Fair 

3 

Good 

4 

Excellent 

5 

Does  Not 

Apply 

|  How  helpful  to  you  are  the  MORS  Symposia  in  the  following  areas? 

a.  Receiving  help  on  a  current  project 

b.  Learning  about  new  data  sources 

c.  Learning  about  models/techniques 

that  you  may  use 

d.  Meeting  colleagues  you  can 

consult  with  in  the  future 

e.  Becoming  aware  of  new  problems 

requiring  analysis 

f.  Broadening  perspectives  of 

military  operations  research 

g.  Other 

h.  Overall,  how  can  MORS  Symposia  be  improved  to  meet  your 

needs? 

4.  Evaluation  of  70th  MORS  Activities 

Not  Satisfied 

1  2 

Satisfied 

3 

4 

Very 

Satisfied 

5 

No 

Opinion 

a  How  satisfied  are  you  with  the  way 

MORS  is  being  managed? 

mmm 

_ 1 

b.  How  helpful  are  the  following  MORS  publications/media  for  yc 

u  or  your  organization?  I 

(1)  Monographs 

(2)  Military  Operations  Research  Journal 

(3)  PHALANX 

(4)  Military  OR  Analyst's  Handbook 

(5)  MORS  Web  Page 

|  c.  How  helpful  are  the  following  MORS  activities  for  you  and  your  organization?  | 

(1)  MORS  Symposium 

(2)  Mini-symposia 

(3)  Workshops 

(4)  Colloquia 

- - 

d.  Suggestions  for  further  activities: 

Do  Not 

Support 

Support 

Strongly 

Support 

No 

Opinion 

(1)  Hold  more  joint  meetings  with 
other  professional  associations 

(2)  Other  (please  specify) 

(3)  Would  you  be  willing  to 

volunteer  your  time  and  effort 

to  pursue  any  of  these? 

Yes 

No 

If  so, 

which 
one(s)? 
(please  list 
=>) 

(£19 


5.  Other  Comments  or  Suggestions 

Please  feel  free  to  continue  writing  on  the  back  or  attaching  additional  sheet(s). 
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6.  Other  Comments  or  Suggestions  (cont.) 

Please  feel  free  to  continue  writing  on  the  back  or  attaching  additional  sheet(s). 
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Place 
1#t  Class 
postage 
here 


Return  to: 


Military  Operations  Research  Society 
1703  N.  Beauregard  Street  #450 
Alexandria  VA  2231 1-1717 
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Chair:  Jon  Davis,  Naval  Warfare  Center 
Co-chairs:  Doug  Anson,  Los  Alamos  National  Laboratory 
Is'  Lt.  Sharon  Christ,  USSTRATCOM/J534 
Advisor:  William  Bearden,  Los  Alamos  National  Laboratory 

Bell  Hall  19A 


The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 


High  Rollers:  Modeling  Autocrats'  Risk  Acceptance  in  Unstable  Regimes 


Prof  Stephen  Biddle 

Army  War  College 

Strategic  Studies  Institute 

Carlisle,  PA  17013-5244 

(717)  245-4128  (fax  (717)  245-3820) 

stephan.biddle@carlisle.armv.mil 


Prof.  Marco  Steenbergen 
Department  of  Political  Science 
University  of  North  Carolina 
307  Hamilton  Hall 
Chapel  Hill,  NC  27599-3265 
msteenbo@email.unc.edu 


Prof.  Norman  Hurley 
Department  of  Political  Science 
University  of  North  Carolina 
307  Hamilton  Hall 
Chapel  Hill,  NC  27599-3265 
nhurlev@email.unc.edu 


A  central  feature  of  U.S.  strategy  in  the  War  on  Terrorism  has  been  our  reliance  on  deterring  or  coercing  state  sponsors 
of  terrorism:  by  threatening  force  we  seek  to  coerce  otherwise  unwilling  states  (Such  as  Yemen,  Somalia,  or  Sudan)  to  crack 
down  on  terrorists  within  their  borders  without  an  actual  U.S.  attack.  Success  in  such  coercive  campaigns  depends  heavily  on 
the  targets’  risk  acceptance.  The  more  risk  averse  the  leader,  the  more  likely  the  state  is  to  comply  with  our  demands  without 
actual  U.S.  intervention.  The  more  risk  acceptant,  on  the  other  hand,  the  more  likely  the  state  will  be  to  test  U.S.  resolve  by 
withholding  full  compliance.  The  viability  of  U.S.  strategy  -  as  well  as  the  tactics  needed  to  implement  it  -  thus  rest  on  our 
assessment  of  risk  preferences  in  the  target  regimes.  This  paper  thus  presents  a  model  of  risk  preference  as  a  function  of 
leadership  selection  effects  in  unstable  political  systems,  tests  this  model  empirically,  and  argues  from  the  results  that  the 
more  unstable  the  regime,  the  more  likely  its  leadership  will  be  risk  acceptant  “high  rollers”  requiring  extraordinary  leverage 
to  coerce.  The  paper  then  derives  implications  from  these  findings  for  U.S.  strategy  in  the  war’s  coming  phases. 


Food  For  Feedback:  An  Operation  Analysts'  Reference  on  Wartime  Data  Collection 


Richard  Bird 

AF/CVXX,  1570  Air  Force  Pentagon 

Washington,  DC  20330-1570,  (703)  696-0744,  richard.bird@pentagon.af.mil 


This  presentation  examines  the  challenges  of  fuzing  dynamically  evolving,  nonlinear,  complex  data  into  exploitable 
knowledge.  In  spite  of  advances  in  information  technology  and  knowledge  management  tools,  cultural  and  organizational 
bias  has  allowed  military  operations  analysis  feedback  processes  to  languish.  Misalignment  of  knowledge  management 
systems  and  degenerated  crosscutting,  comprehensive  data  collection,  management,  and  exploitation  techniques  limits 
warfighters’  access  to  responsive  and  relevant  knowledge  of  combat  operations’  effects.  Nor  are  leaders  necessarily  aware  of 
the  importance  of  exploiting  diverse  and  disparate  information  sources  that  should  be  readily  available  to  them.  In  recent 
conflicts,  feedback  and  remedial  action  has  been  implemented  in  after-action  reports  and  lessons  learned  reports  -  usually 
produced  late  and  neither  widely  read  nor  internalized.  Lessons  were  “observed,”  rarely  “learned.”  Designing  and 
developing  a  comprehensive  concept  operations  and  implementing  it  during  an  ongoing  conflict  is  the  best  way  to  attack  this 
problem. 

Current  ongoing  operations  offer  fertile  opportunity  for  knowledge  management  and  organizational  research.  This 
presentation  provides  an  operations  analysts’  reference  and  resource  on  wartime  data  collection  and  operations  analysis 
support  to  warfighters. 

Functional  Kill:  An  Expanded  Review  of  SSBN  Vulnerabilities 


Duane  E.  Boniface 

Johns  Hopkins  University  Applied  Physics  Laboratory 
Laurel,  MD  20723 

Phone:  (240)  228-3241,  FAX:  (240)  228-3044 
Email:  duane.boniface@ihuapl.edu 


Jonathan  C.  Bierce 

Johns  Hopkins  University  Applied  Physics  Laboratory 
Laurel,  MD  20723 

Phone:  (240)  228-8796,  FAX:  (240)  228-3044 
Email:  i onathan.bierce@i huapl . edu 


Even  after  the  fall  of  the  Soviet  Union  more  than  a  decade  ago,  the  sea-based  leg  of  America’s  nuclear  deterrent  triad 
(the  Navy’s  strategic  ballistic  missile  carrying  submarines  or  SSBNs)  continues  to  be  an  important  foundation  upon  which 
the  nation’s  strategic  security  is  built.  In  the  evolving  geopolitical  order,  it  can  be  argued  that  the  primary  threat  to  the  United 
States  is  no  longer  direct  attack  by  the  nation-state,  but  rather  asymmetric  attack  from  state  or  non-state  actors.  Indeed,  the 
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Secretary  of  Defense  recently  commented  that  Sept.  11th  shows  that  “it  doesn’t  take  a  superpower  to  take  on  the  United 
States.’’  The  overwhelming  superiority  of  American  conventional  military  forces  will  continue  to  drive  potential  adversaries 
to  explore  ways  to  defuse  our  strengths  through  other  than  direct  attacks.  As  current  policy  calls  upon  SSBNs  as  to  be  a 
cornerstone  of  US  strategic  security  into  the  foreseeable  future,  it  is  reasonable  to  assume  that  they  may  be  targeted  for 
asymmetric  attack  as  a  part  of  a  more  comprehensive  strategy. 

Western  nations  traditionally  rely  upon  direct  engagement  of  military  forces  to  achieve  war  objectives.  However,  the 
rest  of  the  world  does  not  necessarily  limit  their  strategic  thinking  in  this  manner  and  may  embrace  a  broader  warfare 
philosophy.  Particularly  noteworthy  in  this  area  is  Chinese  military  thinking,  it  being  the  best  documented  and  most  mature. 
Their  documentation  espoused  war  fighting  methods  integrate  familiar  warfare  disciplines  such  conventional  and  nuclear,  but 
include  also  more  esoteric  forms  such  as  trade,  legal,  media,  ecologic,  and  network  warfare.  Such  a  multifaceted  approach 
has  not  been  experienced  by  the  United  States  to  a  significant  degree,  and  vulnerabilities  and  countermeasure  capabilities  are 
not  well  understood.  In  an  effort  to  better  understand  SSBN  security  in  the  new  strategic  environment,  the  Navy’s  SSBN 
Security  Program  is  sponsoring  an  effort  at  the  Johns  Hopkins  University  Applied  Physics  Laboratory  that  will  explore  force 
vulnerabilities  to  a  broader  (and  less  traditional)  range  of  threats  that  may  come  from  unconventional  directions.  In  effect, 
this  is  very  much  along  the  lines  of  the  Effects  Based  Operations  (EBO)  currently  under  consideration  and  the  subject  of  a 
MORS  Workshop  in  January  2002.  Offensive  utilization  of  EBO  allows  the  movement  from  a  collection  of  locally  optimal 
solutions  within  each  facet  of  coercive  diplomacy  to  a  global  optimal  across  these  facets.  Doing  so  thus  allows  users  to 
capitalize  upon  the  various  synergies  and  dynamic  responses  of  a  multi-faceted  approach.  As  such,  while  the  larger  military 
community  explores  the  potential  of  EBO  from  an  offensive  perspective,  it  behooves  us  to  look  at  our  own  vulnerabilities  to 
EBO  from  a  defensive  perspective.  Such  is  the  focus  of  this  effort. 

This  presentation  describes  initial  efforts  to  model  the  functionality  of  the  Navy’s  strategic  weapon  system.  The  project 
for  which  this  work  is  being  performed  is  interested  in  understanding  the  threats  to  system  functionality  from  action  other 
than  traditional  methods  of  naval  warfare  (e.g.,  torpedoes  and/or  depth  charges)  Termed  the  “Functional  Kill”  project,  this 
current  research  augments  ongoing  reviews  of  threats  of  and  vulnerabilities  to  direct  physical  attacks  on  assets  by  focusing 
instead  on  the  dependencies  of  the  SSBN  on  surrounding  infrastructures.  Specifically,  this  research  is  reviewing  those 
pathways  that  could  lead  to  a  loss  of  operational  capability  that  do  not  require  the  position  of  the  SSBN  to  be  known.  Using 
fault  tree  analyses,  this  analysis  is  structuring  and  evaluating  pathways  that  could  lead  to  a  loss  of  operational  capability,  in 
order  to  identify,  evaluate  and  recommend  countermeasures  for  the  near  term. 

In  addition  to  this  near  term  review  of  threats  and  vulnerabilities,  a  more  detailed  and  encompassing  evaluation  is  being 
initiated,  as  a  form  of  second  generation  analysis.  This  analysis  will  go  beyond  static  fault  tree  modeling  and  will  explore  a 
broader  threat  set,  to  include  more  of  the  pathways  espoused  in  the  Chinese  work.  Using  more  advanced  mathematical 
techniques,  such  as  influence  diagramming  and  various  network  based  approaches,  the  interdependencies,  synergies  and  non- 
linearities  can  be  better  explored  and  accounted  for,  thus  more  accurately  characterizing  the  true  risk  to  SSBN  security. 
These  developing  efforts  will  also  be  outlined  in  this  summary. 

"Strategic  Anti-missile  Attrition  Zone  (SAAZ)  Defense"  -  a  zone  defense  concept  to  meet  the  ever 
changing  ballistic  missile  threat  to  the  United  States ,  its  allies  and  friends 

Michael  A.  Bressler 

1660  Jeb  Stuart  Road 
Ft.  Bliss,  TX  79916-6816 

915-568-2185/2184,  bresslermichael  @otc. army. mil 

The  Department  last  year  conducted  extensive  and  rigorous  missile  defense  reviews  to  determine  how  best  to  fulfill  the 
Nation's  need  to  defend  the  U.S.,  deployed  forces,  allies  and  friends.  The  findings  underscore  the  importance  of  layered 
defenses  as  well  as  the  need  for  new  approaches  to  acquire  and  deploy  missile  defenses.  My  objectives  are: 

•  Establish  a  single  program  to  develop  an  integrated  system  under  a  newly  titled  Missile  Defense  Agency  (MDA). 

•  Assign  the  best  and  brightest  people  to  this  work. 

•  Apply  a  capability-based  requirements  process  for  missile  defense. 

•  Direct  the  MDA  to  develop  the  missile  defense  and  baseline  the  capability  and  configuration  of  its  elements  and  Military 
Departments  to  procure  and  provide  for  operation  and  support. 

•  The  full  and  cooperative  efforts  of  the  Services,  Joint  Staff,  and  defense  agencies  are  essential  to  this  goal." 

-  Donald  Rumsfeld,  Secretary  of  Defense  (  MEMO  of  2  January  2002) 

This  is  a  concept  paper  which  will  do  away  with  conventional  thinking  and  structure  a  practical  approach  to  the 
quagmire  of  uncertainties  associated  with  a  national  missile  defense.  It  will  key  into  the  Defense  Secretary's  desire  to  explore 
new  approaches,  think  beyond  the  conventional,  and  attempt  "out-of-the-box"  vision.  It  will  advance  a  notion  of  shared  cost 
-  shared  responsibility  among  all  the  Armed  Services  making  use  of  all  the  good  and  valuable  work  heretofore  accomplished 
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by  an  unprecedented  Government  /  Contractor  effort.  The  paper  will  be  an  attempt  to  kick-start  thinking  and  provoke 
questions  in  response  to  the  Secretary's  2  January  "guidance"  memorandum  that  clearly  challenges  us  all  to  revitalize  our 
thinking. 

The  Secretary  further  underscores  the  need  for  both  "international  participation"  and  the  "Military  Departments  to 
provide  forces,  as  needed,  to  support  the  fielding  of  early  and/or  contingency  capability  and  will  budget  the  resources  to 
procure  and  operate  the  planned  force  structure". 

In  addition,  the  Secretary's  second  of  four  top  priorities  makes  a  point  of  being  able  to: 

"employ  a  Ballistic  Missile  Defense  System  that  layers  defenses  to  intercept  missiles  in  all  phases  of  their  flight  (i.e.,  boost, 
midcourse,  and  terminal)  against  all  ranges  of  threats." 

The  paper  will  expand  on  the  notion  of  a  zone  defense  that  addresses  the  above  points  made  by  the  Secretary.  Since  the 
paper  is  a  concept  idea  only  certain  assumptions  will  be  made  at  the  onset  which  adhere  to  the  Secretary's  guiding  principles. 
Three  of  the  more  important  assumptions  are: 

Assumption  #1.  That  where  the  missile  defense  objectives  are  in  conflict  with  treaty,  defense  objectives  will  take 
precedence.  Assumption  #2.  That  unconventional  thinking  will  apply  to  multi-service  procurement  and  where  ever  possible 
economy  of  acquisition  and  requirements  will  govern. 

Assumption  #3.  That  flexibility  will  be  the  hallmark  of  implementation  overriding  political  bickering  and  prima-donna 
attitudes. 

The  paper  will  conclude  with  a  hypothetical  war  scenario  taking  place  in  the  year  2025  which  calls  into  play  a  smooth 
working  relationship  of  all  the  Services  including  the  U.S.  Coast  Guard. 


Instructable  Agents  for  Strategic  Center  of  Gravity  Analysis 


Prof.  William  H.  Cleckner 

US  Army  War  College 
Center  for  Strategic  Leadership 
650  Wright  Ave 

Carlisle  Barracks,  PA  17013-5049 
(717)  245-4027 

william.cleckner@csl.carlisle.armv.mil 


Gheorghe  Tecuci,  Prof. 
George  Mason  University 
4400  University  Dr. 
Fairfax,  VA  22030 
(703)  993-1722 
tecuci@gmu.edu 


Jerome  Comello,  Prof. 

US  Army  War  College 

Department  of  Military  Strategy,  Planning,  and 
Operations 
122  Forbes  Ave 
Carlisle  Barracks,  PA  17013 
(717)245-3498,  ierome.comello@carlisle.army.mil 


Students  at  the  U.S.  Army  War  College  are  discovering  new  insights  into  Center  of  Gravity  analysis.  They  both  teach 
and  learn  from  an  intelligent  agent  software  program  called  Disciple,  created  in  the  George  Mason  University  Learning 
Agents  Laboratory  (LALAB).  This  paper  will  describe  a  multi-faceted  research  and  development  effort  that  synergistically 
integrates  research  in  Artificial  Intelligence,  Center  of  Gravity  analysis,  and  practical  deployment  of  an  agent  into  Education. 


USSPACECOM  HMD  Threat-Mission  Study 
Patrick  DuBois 

Analysis  Directorate,  US  Space  Command 
250  S.  Peterson  Blvd.,  Rm.  105 

Peterson  AFB,  CO  80914,  Patrick.dubois@peterson.af.mil 

The  Unified  Command  Plan  (UCP)  tasks  the  United  States  Space  Command  (USSPACECOM)  to  “plan  for  and  develop 
requirements  for  strategic  ballistic  missile  defense,  space-based  support  for  tactical  ballistic  missile  defense  and  space 
operations.”  USSPACECOM/J5B  has  the  command  lead  to  identify  warfighter  strategic  BMD  requirements  and  inscribe 
them  into  the  BMD  CRD.  USSPACECOM/J5B  tasked  USSPACECOM/ AN  to  assist  in  providing  analytical  rigor  to  support 
(substantiate  and  verify)  the  command’s  warfighter  BMD  requirements  delineated  in  the  BMD  CRD.  To  satisfy  the  tasking, 
USSPACECOM/ AN  performed  analysis  to  substantiate  and  verify  the  missions,  roles,  architectures,  performance 
requirements,  and  operational  concepts  described  in  the  Ballistic  Missile  Defense  (BMD)  Capstone  Requirements  Document 
(CRD).  The  background,  methodology  and  the  results  of  this  analysis  (called  the  Threat-Mission  Study)  will  be  presented 


Update  on  the  Weapon  Assignment  Model  (WAM) 

Rachel  Echternach 

United  States  Strategic  Command 

Abstract  unavailable  at  printing. 
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Analysis  of  Terrain  Effects  on  a  Back-up  Fuzing  System  Utilizing  Distance  Traveled 

Les  Greeley 

Naval  Surface  Warfare  Center  Dahlgren  Division,  greeleyal  @nswc. navy. mil 
Abstract  unavailable  at  printing. 

Maintain  Attack  Relative  Timing 

Brandon  Haggard 

Naval  Surface  Warfare  Center  Dahlgren  Division,  haggardbl@nswc.navy.mil 
Abstract  unavailable  at  printing 

RISOP  Analysis 
Kelly  Hanson 

United  States  Strategic  Command 

Abstract  unavailable  at  printing. 

Force  Structure  Analysis  in  support  of  the  NPR 

Pat  McKenna 

United  States  Strategic  Command,  mckennap  @ stratcom. mil 
Abstract  unavailable  at  printing. 

Nuclear  Stockpile  Sizing  for  the  NPR 

Pat  McKenna 

United  States  Strategic  Command,  mckennap@stratcom.mil 
Abstract  unavailable  at  printing. 

Uncertainties  and  Effects  of  a  U.S.  NMD  System 

Fred  Nvland 

nvlandfs@prolvnx.com 

Abstract  unavailable  at  printing. 

Proxy  Weapon  Effectiveness 

Kevin  O'Rourke 

United  States  Strategic  Command,  War  Plans  Analyst  J531 
(402)  294-  0849 

Abstract  unavailable  at  printing. 
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Stability  Assessment  of  the  2001  Nuclear  Posture  Review  Strategies 

Dennis  R.  Powell 

Los  Alamos  National  Laboratory,  Los  Alamos,  NM  87545 
drpowell@lanl.gov 

The  status  of  strategic  nuclear  forces  is  changing  for  both  Russia  and  the  U.S.  While  economic  woes  plague  Russia, 
strategic  system  lifetime  issues  affect  both  nations,  signaling  either  the  development  of  new  strategic  systems  or  lifetime 
extension  programs.  For  the  U.S.,  the  2001  Nuclear  Posture  Review  (NPR)  has  established  initial  directions  for  the  future  of 
U.S.  strategic  policy.  These  policy  issues  were  the  focus  of  many  working  groups  providing  inputs  to  the  NPR.  Many  factors 
affecting  the  U.S.  strategic  posture  and  capabilities  are  addressed,  although  strategic  stability  gets  little  mention  in  the  NPR. 
The  relative  stability  of  the  U.S.  with  respect  to  other  nuclear  capable  nations  is  still  of  interest,  especially  given  reduced 
nuclear  warhead  levels  and  the  expected  introduction  of  missile  defenses.  The  decision  to  unilaterally  reduce  to  1700-2200 
deployed  warheads  was  influenced  by  the  analysis  of  several  force  level  and  strategy  combinations.  Using  classified  sources 
for  U.S.  and  threat  capabilities,  the  force  levels  and  strategies  used  for  the  NPR  are  evaluated  with  respect  to  well  known 
metrics  of  stability.  Using  these  scenarios  as  a  baseline,  limited  ballistic  missile  defense  is  added  to  the  U.S.  strategic  force 
and  its  effect  on  stability  is  examined.  This  analysis  is  intended  to  provide  a  preview  of  the  stability  implications  of  mutual 
strategic  warhead  reductions  up  to  the  year  2015. 

Mobile  Environmental  Effects  Technology 

David  Sauter 

Army  Research  Laboratory 

White  Sands  Missile  Range,  NM  88002 

(505)  675-2078,  dsauter@arl.armv.mil 

Military  operations  and  weapon  systems  are  adversely  affected  to  some  extent  by  the  environment,  even  those  advertised 
as  “all  weather  capable”.  Thus,  it  is  essential  to  provide  advance  warning  of  these  impacts  to  commanders,  and  end  users, 
such  that  intelligent  decisions  can  be  made  regarding  what  weapon  systems  or  tactics  to  employ  as  well  as  where  and  when  to 
employ  them.  The  U.S.  Army  Research  Laboratory  (ARL)  has  developed  a  number  of  automated  software  applications 
designed  to  provide  environmental  information  and  environmental  effects  to  the  end  user.  Much  of  this  technology  has  been 
transitioned  to  fielded  Army  automated  command  and  control  systems.  Recent  research  has  focused  on  the  technology 
development  for  mobile  computing  devices  such  that  lower  echelons  can  eventually  have  access  to  this  vital  intelligence.  In 
addition  to  an  environmental  effects  application,  technology  has  been  developed  to  provide  acoustic  propagation  effects, 
weather  alerts  and  even  a  capability  to  enter  and  transmit  a  local  weather  observation  back  to  a  server.  This  presentation  will 
focus  on  the  applications  that  have  been  developed  for  the  mobile  device. 

Nuclear  Posture  Review:  Challenges  for  the  MORS  Community 

Tom  Scheber 

OSD  Forces  Policy,  Rm  4B868,  The  Pentagon,  Washington,  D.C. 

(703)  895-5553,  Tscheber@mall.policv.osd.mil 

The  Department  of  Defense  has  outlined  in  the  Quadrennial  Defense  Review  (September  2001)  a  general  approach  to 
transform  military  strategy.  The  Nuclear  Posture  Review  (December  2001)  provided  an  additional  level  of  detail  for  the 
transformation  of  the  existing  deterrence  strategy  to  a  broader-based  strategy  that  addresses  the  new  defense  policy  goals. 
The  operations  research  community  provided  the  analytic  framework  for  the  models  and  metrics  by  which  the  past  deterrence 
strategies  were  measured.  The  new  strategy  outlined  in  the  Nuclear  Posture  Review  is  fundamentally  different  from  that  of 
the  past  and  is  much  more  complex.  The  past  strategy  was  threat-based  and  dependent  on  offensive  strategic  nuclear  forces 
and  mutual  vulnerability  to  ballistic  missiles;  it  will  be  replaced  by  a  new,  capabilities-based  strategy.  The  capabilities-based 
force  will  be  characterized  by  a  significantly  reduced  arsenal  of  offensive  strategic  nuclear  weapons  which  will  be  part  of  a 
“New  Triad.”  The  New  Triad  is  comprised  of  offensive  strike  capabilities  (both  non-nuclear  and  nuclear),  defensive 
capabilities  (both  active  and  passive),  and  infrastructure  capabilities  (both  R&D  and  production).  Improvements  in 
intelligence,  planning,  and  command  and  control  also  will  be  required  to  provide  flexibility  and  to  integrate  the  capabilities  of 
the  New  Triad.  This  new  framework  will  present  new  challenges  and  opportunities  for  the  operations  research  community. 
New  models  and  metrics  will  need  to  be  developed  to  guide  the  development  of  the  New  Triad  and  to  measure  its 
effectiveness.  Many  details  regarding  new  capabilities,  planning  systems,  and  employment  concepts  remain  to  be  developed. 
The  operations  research  community  will  need  to  play  a  significant  role  to  provide  options  to  the  national  leadership  in  this 
time  of  innovative  transition.  This  presentation  will  provide  an  overview  of  the  new  strategy  and  will  outline  the  challenges 
associated  with  the  New  Triad  concept  for  the  MORS  community. 
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Nuclear/Conventional  Weapons  Tradeoffs 
Gene  Schroeder 

Los  Alamos  National  Laboratory,  schroeder @  lanl .  go v 
Abstract  unavailable  at  printing. 

Advanced  Analysis/Planning  -  Object  Oriented  Design 
Gene  Schroeder 

Los  Alamos  National  Laboratory,  schroeder@lanl.gov 
Abstract  unavailable  at  printing. 

High  Power  Electromagnetic  (HPEM)  Threat  Considerations 

Donna  Smoot,  NH-III  (GS-13)  John  O’Kuma,  GS-15 

Commander,  ATEC  Commander,  ATEC 

ATTN:  CSTE-AEC-SVE-S  ATTN:  CSTE-DTC-WS-DT-A 

4120  Susquehanna  Ave.,  WSMR,  NM  88002-5158 

APG,MD  21005-3013  (505)  679-6631,  Fax:  (505)  670-( 

(410)  306-0451  Fax:  (410)  306-0467  Okuma@datts.wsmr.armv.mil 
Smootdonna@usaec.armv.mil 

Terrorist  events  have  forced  the  United  States  to  rethink  the  exploitation  of  weapons  of  mass  destruction  and  high 
technology  weapons.  Identification  of  the  threat  capabilities  of  low  technology  terrorist  forces  is  blurred  by  the  financial 
ability  to  purchase  high  technology  weapons.  Consequently,  some  commercial  and  industrial  organizations  in  the  U.S.  may 
not  understand  the  need  for  or  possibility  of  protecting  their  information  and  equipment  against  the  electromagnetic  threats. 

An  exoatmospheric  detonation  of  even  a  single  nuclear  warhead  could  result  in  a  high-altitude  electromagnetic  pulse 
(HEMP)  having  far-reaching  effects  on  unprotected  electronic  systems  without  affecting  people.  Orbiting,  air,  and  ground 
systems  could  be  affected  by  this  form  of  F1PEM.  Non-nuclear  sources  of  HPEM  energy  could  also  produce  similar  effects 
locally.  In  either  type  of  HPEM  event,  it  may  take  hours  or  even  longer  before  people  realize  the  cause  and  extent  of  the 
resulting  equipment  malfunctions. 

The  frequencies  and  intensities  of  signals  coupled  into  systems  from  various  HPEM  threats  are  similar  in  many  ways. 
Hardening  systems  against  the  effects  from  both  sources  at  the  same  time  prevents  unbalanced  hardening,  unnecessary 
hardening  overlap,  and  reduces  hardening  and  sustainment  costs.  Actions  can  be  taken  to  increase  the  protection  of  U.S. 
commercial  and  military  interests.  This  paper  will  explore  some  of  the  effects  of  nuclear  and  non-nuclear  HPEM.  Lessons 
learned  in  test  and  survivability  evaluation  of  Army  systems  will  be  presented  along  with  protection  solutions  ranging  from 
design  considerations  to  simple  steps. 


Robert  Pfeffer,  GS-15 
USArmy  Nuclear  &  Chemical  Agency 
ATTN:  ATNA-NU,  7150  Heller  Loop, 
Suite  101 

Springfield,  VA  22150-3198 
(703)  806-7860,  Fax  (703)  806-7900 
Pfeffer@usanca-smtp.army.mil 
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The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 

Radioprotectant  Pharmaceuticals:  Force  Protection  in  the  Post  Nuclear  Environment 

COL  Ed  Baldwin 

USSTRATCOM 

Command  Surgeon,  Offutt  AFB,  NW  68113 
402-294-5860,  baldwint@stratcom.mil 

The  post  nuclear  environment  would  include  exchange  of  weapons,  terrorist  use  of  "  dirty"  conventional  bomb,  or  a 
reactor  accident.  Radioprotectant  pharmaceuticals  include  pre-treatment  and  immediate  post-exposure  treatment  that  can 
mitigate  symptoms  and  cytotoxic  effects,  including  chromosomal  damage  and  long  term  sequelae.  Some  of  these 
pharmaceuticals  are  FDA  approved  today  for  radiation  therapy  use,  and  granisetron,  has  a  sanctioned  military  use  and  dose 
pack.  Research  projects  underway  at  the  Armed  Forces  Radiobiological  Research  Institute  (AFRRI)  and  discussed  in  a  recent 
DOD,  NCI,  NIH  Interagency  Workshop  "Molecular  and  Cellular  Biology  of  Moderate  Dose  Radiation  and  Potential 
Mechanisms  of  Radiation  Protection"  promise  substantial  enhancement  of  the  generally  considered  LD50  doses  used  in 
consequence  models  today.  This  paper  would  summarize  this  research  and  propose  operational  scenarios,  pretreatment  of 
military  members,  and  stockpiling  of  radioprotectant  pharmaceuticals. 

Sensitivity  Analysis  of  a  Manual  Decision  Support  Tool  for  Making  Protective  Action  Decisions  for 
the  Public 


Michael  Boechler 

Innovative  Emergency  Management 

8555  United  Plaza  Blvd.,  Ste.  100,  Baton  Rouge,  LA  70816 

(225)  952-8274  (fax  (225)  952-8122) 

michael.boechler@ieminc.com 


Brad  Tiffee 

Innovative  Emergency  Management 

8555  United  Plaza  Blvd.,  Ste.  100,  Baton  Rouge,  LA  70816 

(225)  952-8229  (fax  (225)  952-8122) 

brad.tiffee@ieminc.com 


J.  Krause  Wilson 

Innovative  Emergency  Management 

8555  United  Plaza  Blvd.,  Ste.  100,  Baton  Rouge,  LA  70816 

(225)  952-8231  (fax  (225)  952-8122) 

Krause.Wilson@ieminc.com 


Sam  Martin 

Innovative  Emergency  Management 

8555  United  Plaza  Blvd.,  Ste.  100,  Baton  Rouge,  LA  70816 

(225)  952-8191  (fax  (225)  952-8122) 

sam.martin@ieminc.com 


This  paper  presents  the  results  of  a  sensitivity  analysis  performed  on  a  protective  action  recommendation  algorithm 
developed  to  aid  decision-makers  in  the  event  of  a  chemical  stockpile  emergency  involving  the  release  of  chemical  agent  into 
the  atmosphere.  The  development  of  the  decision  algorithm  via  QEM-World®  and  the  design  of  the  sensitivity  analysis  are 
discussed.  The  design  involved  an  examination  of  the  effects  of  the  following  factors  on  the  output  of  the  algorithm  and  on 
risk  to  the  community  surrounding  the  chemical  stockpile  site:  emergency  response  characteristics,  warning  diffusion 
properties,  public  response  characteristics,  indoor  air  exchange  rates,  breathing  rate  and  agent  toxicity.  The  analysis  revealed 
that  changes  in  warning  diffusion  and  agent  toxicity  assumptions  were  associated  with  the  largest  changes  in  the  algorithm 
output,  while  toxicity  and  breathing  rate  assumptions  exerted  the  largest  effects  on  the  risk  to  the  community.  Implications 
for  application  of  the  guidebook  methodology  to  the  post-9/ 1 1  environment  are  discussed. 


Cryogenic  Abatement  of  Spill-Induced  Toxic  Vapor  Plumes:  A  feasibility  study 
Doyle  S.  Elliott 

U.S.  Army  Research  Laboratory,  WSMR,  NM  88002 
505-678-6509  (fax  505-678-1230),  selliott@arl.armv.mil 

The  remediation  of  volatile  toxic  liquid  spills  and  abatement  of  toxic  plumes  is  of  increasing  concern.  Current 
methodology  for  emergency  remediation  of  chemical  spills  usually  involves  evacuation  plus  the  use  of  physical  methods, 
such  as  barriers  (dikes)  and  absorption  using  clay  and  removal  with  heavy  equipment,  and  when  applicable,  bioremediation 
methods  or  chemical  methods  are  used  to  neutralize  the  spilled  chemical.  Only  in  recent  years  has  frozen  soil  barrier 
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technology  been  used  for  environmental  remediation  of  contaminated  soil.  None  of  the  current  methods  immediately  and 
specifically  address  the  abatement  of  the  vapor  plume  induced  by  the  chemical  spill.  The  feasibility  study,  by  using 
calculated  estimates  and  computer  modeling,  indicates  that  the  use  of  inexpensive  cryogenic  liquids  such  as  liquid  nitrogen 
(LN2)  shows  promise  in  the  abatement  of  toxic  volatile  materials  spilled  as  liquids  into  the  surface  layer.  Chilling  and/or 
freezing  of  the  spilled  chemical  at  the  surface  minimizes  the  evaporation  and  diffusion  of  the  liquid  (or  sublimation  of  solid), 
and  therefore,  the  plume  concentration  and  volume.  Introduction  of  spray  (water  or  other  liquid)  into  the  plume  to  directly 
washout  the  chemical  and  to  form  a  frozen,  impermeable  crust  on  top  of  the  spill  area  may  further  reduce  the  plume 
concentration  and  volume. 


A  Simple  and  Fast  Method  for  the  Estimation  of  the  Utility  of  Various  Mixes  of  Fixed  and  Mobile 
Point  Biological  Agent  Detector  Systems 


Jerry  Jensen 

Simulation  Technologies,  Inc. 

1 1 1  W.  First  Street,  Suite  748 
Dayton,  OH  45402-1106 
937-258-2273,  xl6  (Fax:937-258- 
2274)  ierry.iensen@stiusa.com 


Maj.  W.  Paul  Murdock,  USAF 

AFRL/HEST 

2698  G.  Street,  Bldg  190 

WPAFB,  OH  45433-7604 

937-255-3140  (Fax:  937-656-4664) 

William.Murdock@wpafb.af.mil 


Mark  W.  Fagan 

AFRL/HEST 

2698  G.  Street,  Bldg  190 

WPAFB,  OH  45433-7604 

937-255-3161  (Fax:  937-656-4664) 

Email:  Mark.Fagan@wpatb.af.mil 


The  evaluation  of  complex  mixes  of  fixed  and  mobile  point  detection  systems  is  difficult  due  to  the  many  issues 
affecting  their  utility.  Key  issues  include  the  number  of  fixed  and  mobile  detectors,  the  size  of  the  protected  area,  detector 
operation  (detection  cycle  time,  movement  and  setup  time),  false  alarm  rate,  number  of  simultaneous  detections  required,  and 
threat  (detectable  cloud  size  and  duration).  The  method  was  constructed  to  complement  a  complex  Monte  Carlo  class  model 
(STAFFS  -  Simulation  Training  and  Analysis  for  Fixed  Sites)  used  to  evaluate  a  wide  range  of  detector  mixes,  operational 
concepts,  target  sizes,  weather,  and  threats.  Detailed  Monte  Carlo-type  methods  involve  complex  data  streams  and  long 
execution  times  that  limit  the  number  of  cases  that  can  be  examined.  The  simple  method  allowed  a  wider  range  of  cases  to  be 
examined  (albeit  at  a  lower  level  of  resolution)  so  that  key  sensitivities  could  be  established  and  used  to  reduce  the  case 
matrix  of  the  complex  model.  The  simple  method  also  permits  an  analyst  to  quickly  discover  fundamental  relationships 
between  overall  system  performance  and  detector  characteristics,  The  method  uses  a  simple  binomial  algorithm  to  combine 
detection  probabilities  for  individual  detectors. 


Assessment  of  CW  on  Airbase  Operations 


John  P.  Lawrence 

SAIC 

1710  SAIC  Drive 
McLean,  VA  22102 
703-676-4770  (Fax:  703-676-5093) 
lawrencei@saic.com 


Richard  McNally 
SAIC 

2111  Eisenhower  Avenue,  Suite  205 
Alexandria,  VA  22314 
703.683.7900  (Fax:  703  683  7905) 
Mcnallvr@saic.com 


Laura  Koepfler 
SAIC 

1710  SAIC  Drive 
McLean,  VA  22102 
703.676.4116  (Fax:703.676.5093) 
Koepflerl@saic.com 


Recent  studies  and  analysis  have  challenged  many  historical  assumptions  concerning  airbase  operations  in  a  chemically 
contaminated  environment.  Studies  revealed  that  with  revised  CONOPS  and  procedures,  combat  sortie  generation  activities 
could  resume  quicker  and  safer.  Previous  Air  Force  sortie  degrade  inputs  to  the  QDR  were  in  excess  of  40%  and  subsequent 
J8  WMD  studies  reported  a  25-30%  degrades.  These  operationally  unacceptable  degrades  subsequently  initiated  a  series  of 
studies  and  live-agent  testing,  resulting  in  the  Air  Force  re-examining  hazard  duration  values  previously  used  and  re-defining 
airbase  chemical  warfare  operational  environment.  Analysis  conducted  using  the  re-defined  understanding  of  the  airbase 
specific  environment  has  shown  that  there  are  opportunities  to  significantly  increase  operational  capability  through  changes 
in  CONOPS  and  procedures. 

The  current  analysis  reflects  the  impact  of  these  refined  C-CW  CONOPS  on  the  ability  to  significantly  recover  sortie 
generation  combat  power  in  a  CW  environment.  It  quantifies  the  contribution  of  functional  components  to  the  overall  sortie 
generation  degrade,  and  the  recovery  possible  by  implementing  the  revised  C-CW  CONOPS.  Analysis  was  conducted  using 
Expediter,  and  AF/XONP  model.  It  is  an  event  driven,  intelligent  agent  simulation  that  allows  for  realistic  interactions 
between  airbase  functional  systems,  down  to  the  individual  asset  level.  This  analysis  identifies  key  operational  vulnerabilities 
and  possible  mitigation  strategies  that  could  minimize  these  vulnerabilities  and  maximize  the  operational  capability  of  the 
base. 

The  results  of  the  analysis  indicate  that  the  procedures  developed  in  the  C-CW  CONOPS,  tailored  to  each  specific 
location  and  mission,  can  improve  sortie  generation  rates  by  up  to  30%.  The  revised  sortie  generation  degrades  provided  to 
the  QDR  CIWG  were  between  5%  and  15%  (varied  by  base),  significantly  lower  than  traditional  assessments. 
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The  Modified  Covering  Problem  on  Paths  and  Trees 

CPT  Brian  J.  Lundav 

Dept,  of  Mathematical  Sciences,  West  Point,  NY  10996 
845-938-4604  (fax  845-938-2409),  brian.lundav@us.armv.mil 

The  Modified  Covering  Problem  (MCP)  is  introduced  as  a  subset  of  the  Set  Covering  Problem  (SCP).  The  MCP  seeks  to 
minimize  the  number  of  uniform-capability,  uniform-cost  facilities  required  in  order  to  cover  all  demands  with  the 
requirement  that  a  demand  cannot  be  covered  by  a  collocated  facility.  The  motivations  for  the  MCP  include  two  categories  of 
applied  problems:  when  a  facility  cannot  serve  a  demand  as  its  own  location  and  when  a  facility  has  both  a  minimum  and  a 
maximum  covering  radius.  One  example  in  the  first  category  is  the  location  of  the  Weapons  of  Mass  Destruction  Civil 
Support  Teams,  as  an  NBC  strike  may  disable  them  from  responding  to  their  own  city. 

The  MCP  is  then  formulated  as  a  binary  integer  program.  A  polynomial  algorithm  is  developed  for  solving  the  MCP  on 
paths  with  uniform  link  distances,  and  solving  within  20%  of  optimality  on  paths  with  non-uniform  link  distances.  Next,  an 
exponential  algorithm  is  developed  to  solve  non-uniform  link  distance  problems  to  optimality.  Finally,  an  algorithm  is  shown 
to  develop  strong  upper  and  lower  bounds  for  the  optimal  solution  on  trees  with  non-uniform  link  distances.  Continuing 
efforts  focus  on  developing  a  polynomial  algorithm  for  non-uniform  link  paths. 

Protective  Action  Decision  Making  Using  D2-PuffTM  and  SafePortTM 

Sam  Martin 

Innovative  Emergency  Management 

8555  United  Plaza  Blvd.,  Ste.  100,  Baton  Rouge,  LA  70816 

(225)  952-8191  (fax  (225)  952-8122),  sam.martin@ieminc.com 

Choosing  a  protective  action  (evacuate  or  shelter)  for  the  general  public  in  the  event  of  a  chemical  agent  release  can  be 
complicated.  The  correct  protective  option  changes  with  the  type  of  hazard,  the  time  available  to  respond,  weather  forecasts, 
conditions  in  the  community,  and  a  host  of  other  factors.  Emergency  management  decision-makers  can,  at  the  same  time,  be 
overloaded  with  information  and  not  have  access  to  the  proper  information  to  make  a  good  decision.  D2-Puff™  and 
SafePort™  provide  emergency  managers  the  ability  to  store  and  analyze  this  critical  information  and  use  it  effectively  in  an 
emergency.D2-Puff™  is  an  advanced  dispersion  model  developed  by  IEM  that  draws  a  picture  of  the  most  likely  path  of  the 
toxic  cloud  or  "plume, n  based  on  the  hazardous  substance's  properties  and  the  local  weather  conditions.  D2-Puff™  fully 
accounts  for  the  way  in  which  changes  in  the  weather  over  time  affect  the  shape  and  severity  of  the  plume,  giving  analysts  a 
more  realistic  picture  of  the  hazard.  D2-Puff™  also  models  dispersion  over  complex  terrain  and  processes  weather  data  from 
the  Internet.  SafePort™  is  a  computer-based  expert  decision  support  system  that  can  be  adapted  to  a  wide  variety  of  hazards. 
SafePort™  accounts  for  specifics  of  the  local  plans  and  procedures,  sociological  responses,  and  community  and  traffic 
conditions.  It  generates  the  protective  action  recommendations  that  provide  the  greatest  protection  for  populations  affected  by 
the  unfolding  scenario.  SafePort™  considers  the  current  situation  with  regard  to  demographics,  sociological  factors,  roadway 
characteristics,  and  hazard  information.  This  presentation  will  address  the  use  of  D2-Puff™  and  SafePort™  in  an  operational 
setting  and  from  a  modeling  standpoint.  The  impact  of  the  stored  data  on  the  output  will  be  discussed  as  well  as  an  overview 
of  how  these  two  tools  used  in  conjunction  can  enhance  the  safety  of  the  general  public. 


Biological  Warfare  Amateur  Methodology 


Peter  B.  Merkle,  Ph.D. 

DTRA(ASCO) 

8725  John  J.  Kingman  Road,  MS  6201 
Fort  Bel  voir,  VA  22060-6201 
703-767-5711  (fax  703-767-5701) 
Peter.Merkle@dtra.mil 


John  P.  Wood 

Westinghouse  Safety  Mgmt  Solutions 
1993  S.  Centennial  Avenue 
Aiken,  SC  29803 
803-502-9756 
iohn.wood@wxsms.com 


Tom  Konitzer  and  R.  Cary  Tuckfield 
Westinghouse  Safety  Mgmt  Solutions 
1993  S.  Centennial  Avenue 
Aiken,  SC  29803 
803-502-9756 


We  have  estimated  the  likelihood  that  small  groups  of  true  "amateurs"  could  successfully  devise  a  competent  biological 
weapon  and  execute  an  attack,  in  the  absence  of  state  program  support,  using  only  open-source  information.  This  study  began 
in  July  1999  and  continued  through  Feb,  2002  and  involved  >150  individuals  comprising  >30  small  groups  spanning  a  broad 
range  of  educational  level,  technical  expertise,  work  experience,  and  age. 
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Weapons  of  Mass  Destruction  « Impact  on  Army  Operations 
MAJ  Jon  Payne 

Center  for  Army  Analyses,  6001  Goethals  Road,  Suite  102,  Fort  Belvoir,  VA,  22060-5230 
703-806-5495  (fax  703-806-5725),  pavne@caa.armv.mil 

Recent  WMD  studies  have  focused  on  the  effects  at  specific  nodes  during  force  projection  or  during  offensive/defensive 
operations  in-theater.  These  studies  are  stand-alone  and  not  linked  to  provide  a  comprehensive  assessment  of  the  effects  on 
the  Army  across  the  spectrum  of  operations  and  across  lines  of  communication.  This  study  examined  previous  studies  to 
determine:  Army  WMD  vulnerabilities  during  the  Mobility,  Deployment  and  Employment  phases  of  Force  Projection; 
planning  guidance  to  reduce  impact  on  operations  by  threat  use  of  WMD  to  deny  or  limit  LOCs;  provide  insights  and 
recommendations  for  changes  in  WMD  defense  to  reduce  vulnerabilities.  Analysis  methodology  is  described  and  results  are 
shown. 

Southwest  Asia  Near  Year  Analysis  (SWANY)  Chemical  Excursion 

MAJ  Jon  Payne 

Center  for  Army  Analyses,  6001  Goethals  Road,  Suite  102,  Fort  Belvoir,  VA,  22060-5230 
703-806-5495  (fax  703-806-5725),  pavne@caa.armv.mil 

This  study  examines  the  use  of  chemical  weapons  against  US  ground  forces  in  the  context  of  CENTCOM's  current 
operational  plan  (OPLAN)  for  Southwest  Asia  (SWA).  The  sponsor  of  this  study,  ARCENT,  requested  that  an  excursion  be 
conducted  separately  from  CAA's  ground  campaign  analysis  of  the  current  year  OPLAN.  The  chemical  excursion  analyzes 
the  impact  of  a  theater  ballistic  missile  (TBM)  and  ground  campaign  where  chemical  weapons  are  used  against  US  ground 
forces.  The  intelligence  community  estimated  threat  stockpile  was  allocated  to  delivery  systems  and  a  TBM  campaign  was 
conducted  using  the  Extended  Air  Defense  Simulation  Model  (EADSIM)  and  the  Post  Engagement  Ground  Effects  Model 
(PEGEM)  and  the  ground  campaign  was  conducted  using  the  T  AC  WAR  theater  simulation.  The  effectiveness  of  the  threat's 
chemical  campaign  was  analyzed  and  operational  planning  considerations,  based  on  the  results  of  the  chemical  excursion, 
were  provided  to  ARCENT. 

Joint  Integrated  Combat  Model  (JICM)  NBC  Module  Design  and  Development 

MAJ  Jon  Payne  MAJ  Steven  Charbonneau 

Center  for  Army  Analyses  Center  for  Army  Analyses 

6001  Goethals  Road,  #  102,  Fort  Belvoir,  VA,  22060-5230  6001  Goethals  Road,  #  102,  Fort  Belvoir,  VA,  22060-5230 

703-806-5495  (fax  703-806-5725),  pavne@caa.armv.mil  703-806-5474,  Charbonneau@caa.armv.mil 

The  Joint  Integrated  Combat  Model  (JICM)  is  a  low-resolution,  expected  value,  theater-level  model.  In  order  to 
streamline  campaign  analyses,  the  development  of  the  JICM  NBC  module  was  required  to  minimize  off-line  processing  and 
the  associated  overhead  of  shadowing  the  campaign  in  TACWAR.  NBC  effects  addressed  are:  the  physical  properties  and 
characteristics  of  agents  (from  a  VLSTRACK-based  database);  effects  of  people  (including  Mission  Oriented  Protective 
Posture  degradation);  effects  on  equipment  and  terrain;  NBC  Warning  and  Reporting;  and,  decontamination.  Design  and 
development  methodology  is  described  and  results  are  shown. 

Military  Installations  Worldwide  —  Antiterrorism  and  WMD 

Rod  Propst 

Analytic  Services,  Inc.,  2900  South  Quincy  Street,  Suite  800 
Arlington,  VA  22206,  Phone:  703-416-8476  (fax:  703-416-3329) 

E-mail:  Rodney. propst @ anser.org 

Abstract  unavailable  at  printing. 

Foot  and  Mouth  Disease:  Should  the  U.S .  Army  be  concerned? 

Belinda  Scheber 

Center  for  Army  Analyses 

6001  Goethals  Road,  Suite  102,  Fort  Belvoir,  VA,  22060-5230 
703-806-5559  (fax  703-806-5725)  scheber @ caa . army . mi  1 

This  study  examines  the  potential  impact  on  military  readiness  because  of  major  livestock  epidemic  in  the  United  States. 
The  study  focuses  on  the  potential  for  foot  and  mouth  disease  (FMD)  to  infect  U.S.  livestock  and  the  resultant  impact  on  the 
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readiness  of  the  US  Army  deployment  and  training  readiness.  It  uses,  as  a  recent  example,  the  outbreak  of  FMD  in  the  UK 
and  the  use  of  military  personnel  to  assist  with  the  mitigation  of  FMD  and  also  impacts  on  training  estates.  UK  military 
readiness  was  impacted  in  several  different  ways  during  this  outbreak.  The  study  then  uses  the  UK  example  and  applies 
potential  outbreaks  to  the  regions  of  the  US  containing  US  Army  installations  collocated  with  the  dense  livestock 
populations.  Analysis  involves  such  modeling  tools  such  as  ESRI’s  ARCVIEW  and  USDA/ APHIS  “SpreadModel” 

A  Model  for  a  Federal  Role  in  the  Consequence  Management  Preparedness  of  State  and  Local  First 
Responders 

Donald  C.  Snyder,  Ph.D. 

US  General  Accounting  Office  (GAO) 

Room  4A12,  441  G  St,  NW,  Washington,  DC  20548 
SnvderD@GAO.GOV 

The  mission  of  the  Office  of  Homeland  Security  will  be  to  develop  and  coordinate  national  efforts  to  prepare  for  and 
mitigate  the  consequences  of  a  terrorist  attack.  To  do  this,  the  Office  will  coordinate  local  response  plans  and  exercises  and 
coordinate  training  for  federal,  state,  and  local  first  responders.  This  symposium  presents  a  model  for  a  federal  roles  in  the 
consequence  management  preparedness  of  state  and  local  first  responders.  The  model  design  is  based  on  a  successful 
program  that  FEMA  operates  for  the  Army.  The  program,  the  Chemical  Stockpile  Emergency  Preparedness  Program,  or 
CSEPP,  enhances  the  preparedness  of  local  responders  and  offers  a  tested  model  for  delivering  federal  assistance  and 
guidance  to  state  and  local  agencies.  Federal  funding  is  based  on  the  varying  needs  for  critical  items  (such  as  protective 
equipment  and  response  plans)  of  the  states  and  local  communities. 


Characterization  of  Fighter  Base  and  APOD  Operations  for  Biological  Defense 


Tom  Stark,  Ph.D. 

Cubic  Defense  Systems 
6927  Telegraph  Rd. 
Alexandria,  VA  22310 
(703)  924-3050 
tom.stark@cubic.com 


Charles  L.  Fromer 
DTRA(CB) 

6801  Telegraph  Road 
Alexandria,  VA  22310 
703-325-8165  (fax:  703-325-2136) 
Charles. fromer  contractor@dtra.mil 


Tom  Sterle 

Simulation  Technologies,  Inc. 

1 1 1  West  First  Street,  Ste.  748 
Dayton,  OH  45402 
937-258-2273  (fax  937-258-2274) 
sterlet@stiusa.com 


As  part  of  the  ongoing  RestOps  Advanced  Concept  Technology  Demonstration  (ACTD),  a  set  of  "table-top"  exercises 
are  being  conducted  in  order  to  enhance  the  base's  ability  to  respond  to  biological  attacks.  In  this  presentation,  we  describe 
the  methods  and  tools  used  to  provide  analytical  support  to  these  exercises.  This  includes  the  use  of  NBC  dosage  and  casualty 
models,  the  spatially-dependent  base  population,  and  the  characterization  of  fighter  base  and  APOD  operations. 


Effectiveness  Criteria  for  the  RestOps  CB  Defense  Situational  Awareness  Tool 


Tom  Stark.  Ph.D 

Cubic  Defense  Systems 
6927  Telegraph  Rd. 
Alexandria,  VA  22310 
(703)  924-3050 
tom.stark@cubic.com 


Charles  L.  Fromer 
DTRA(CB) 

6801  Telegraph  Road 
Alexandria,  VA  22310 
703-325-8165  (fax:  703-325-2136) 
Charles. fromer  contractor@dtra.mil 


John  Redding 

Logistics  Management  Institute 
2000  Corporate  Ridge 
McLean,  VA  22102 
703-917-7051  (fax  703-917-7104) 
iredding@lmi.org 


William  J.  Ginley 

PM-NBC  Battlefield  Mgmt  Team,  SBCCOM 
Aberdeen  Proving  Ground,  MD  21010 
410-436-5649  (fax  410-436-3235) 
william.ginlev@sbccom.apgea.armv.mil 


Mike  Smith 

ITT  Systems 

2560  Huntington  Ave. 

Alexandria,  VA  22303 

703-329-7172  (fax  703-329-7197),  mike.smith@itt.com 


An  assessment  of  capabilities  for  the  Restoration  of  Operations  (RestOps)  Advanced  Concept  Technology 
Demonstration  (ACTD)  led  to  the  need  for  an  IT-based  system  for  Chemical  and  Biological  (CB)  Defense  situational 
awareness  at  the  candidate  military  base.  A  necessary  part  of  development  and  deployment  of  such  a  system  is  the 
development  of  effectiveness  criteria  for  judging  the  system's  utility.  The  effort  has  been  nontrivial,  since  military  systems 
whose  goal  is  to  transmit,  disseminate  or  display  information  for  the  purpose  of  decision-making  often  defy  the  use  of 
conventional  effectiveness  criteria.  In  this  presentation  we  describe  the  RestOps  CB  situational  awareness  tool,  its  use  at 
Osan  AB,  and  the  effectiveness  criteria  that  have  been  developed  to  evaluate  the  system. 
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Comparison  and  Analysis  of  Medical  Courses  of  Action  in  the  NBC  Environment 

Sharon  M.  Watts  and  Michael  T.  Gately  William  J.  Klenke 

ScenPro,  Inc.,  101  W.  Renner  Road  Suite  130  Anteon,  AMEDDCS 

Richardson,  Texas  75082  William.Klenke@CEN.AMEDD.ARMY.MIL 

(972)  437-5001  FAX:  (972)  437-3611 
SWatts@ScenPro.com,  MGatel v @ScenPro.com 

The  Nuclear,  Biological,  and  Chemical  Casualty  Resource  Estimation  Support  Tool  (NBC  CREST)  supports  deliberate  medical 
planning  in  an  iterative,  integrated  process  for  US  Army  medical  planning  at  the  Corps,  Division,  and  Corps  Medical  Brigade  levels.  The 
Course  of  Action  (COA)  Comparison  module  of  NBC  CREST  compares  and  ranks  alternative  medical  COAs  to  identify  the  best  medical 
course  of  action.  The  comparisons  are  based  upon  Deployment,  Disposition,  and  Utilization  (DDU)  criteria  for  a  user-defined,  nuclear, 
biological,  or  chemical  casualty  scenario.  Deployment  is  defined  as  the  medical  footprint  or  the  combined  total  number  of  MTFs  and 
medical  personnel  deployed  to  meet  the  estimated  resource  demands  of  treating  the  patient  stream.  Disposition  represents  the  end  state 
disposition  of  each  patient  who  receives  medical  treatment.  Patients  Die  of  Wounds  (DOW),  Return  to  Duty  (RTD),  or  are  Evacuated  Out 
of  Theater.  Utilization  reflects  the  resource  usage  linked  to  individual  MTFs  composing  the  deployeds  medical  network.  Resources  include 
Beds,  Personnel,  Class  VIII  Materiel,  and  Evacuation  Assets.  The  DDU  criteria  are  weighted  according  to  the  specific  mission  goals  and 
commander  intent.  As  events  change  users  are  able  to  redefine  the  level  of  importance  placed  on  each  of  the  DDU  criteria  by  simply 
modifying  default  values  used  in  the  comparison  evaluation.  Under  each  of  the  three  major  criterions  a  sub-category  breakdown  is  provided 
allowing  for  ranking  of  individual  factors  that  compose  the  overall  criteria,  including  two  types  of  comparison  algorithms.  The  NBC 
CREST  is  currently  being  developed  in  conjunction  with  the  Army  Office  of  the  Surgeon  General  (OTSG). 

Magnus  Rotor  Bomblet  and  Spherical  Submunition  Aerodynamic  Thermal  Demise 
Wm.  Glenn  Wilk  Sandra  Payne 

MEVATEC  Corp,  1525  Perimeter  Parkway,  Suite  500  MEVATEC  Corp,  1525  Perimeter  Parkway,  Suite  500 

Huntsville,  AL  35806  Huntsville,  AL  35806 

256-890-8090  (fax  256-890-0000)  256-890-8090  (fax  256-890-0000) 

glenn.wilk@mevatec.com  sandra.pavne@mevatec.com 

Evaluating  the  effectiveness  of  submunition  missile  designs  requires  predicting  where  surviving  submunitions  will  impact  the  ground 
relative  to  defended  assets.  Traditionally,  surviving  submunitions  referred  to  those  that  continue  functioning  after  a  hit-to-kill  or 
fragmenting  warhead  missile  intercept.  However,  for  high  altitude  or  early  releases,  submunitions  must  also  survive  aerodynamic  thermal 
heating.  This  paper  discusses  the  aerodynamic  thermal  demise  analysis  performed  for  two  common  ballistic  missile  submunition  designs: 
1)  a  smooth  spherical  submunition  that  is  often  referenced  as  a  chemical  bomblet  and  2)  a  Magnus  rotor,  biological  bomblet  that  has  vanes 
on  the  surface  that  spins  the  submunition  when  moving  through  the  atmosphere.  Release  conditions  were  derived  from  typical  ballistic 
missile  trajectories  compiled  from  the  Ballistic  Missile  Reference  Document.  The  release  conditions  at  which  these  typical  submunitions 
are  all  likely  to  survive  or  are  all  likely  to  demise  are  discussed.  Implications  of  analysis  may  show  the  value  or  disadvantage  in  terms  of 
ground  effects  of  engaging  submunition  threats  at  high  altitude  or  early  in  flight.  The  analysis  was  performed  using  the  Post-Engagement 
Ground  Effects  Model  (PEGEM)  Version  4.1,  which  employs  submunition  dispersion,  propagation,  and  aerodynamic  thermal  demise 
modules.  Sponsored  by  the  Missile  Defense  Agency,  PEGEM  provides  a  comprehensive  tool  for  assessing  the  effectiveness  of  weapon  and 
interceptor  systems  in  terms  of  ground  effects  for  chemical  and  biological  missile  defense.  PEGEM  submunition  modules  propagate 
submunitions  throughout  their  trajectory  with  a  high-order,  quick  running,  three  degree-of- freedom  numerical  integration  routine  that 
incorporates  aerodynamic  coefficients  representative  of  submunition  and  drag  augmentation  designs.  The  aerodynamic  thermal  demise 
model  is  based  on  stagnation  point  heat  transfer  in  dissociated  air  as  applied  to  reentry  body  nose-cone  heating  with  the  addition  of  radiant 
cooling  effects.A  Quantitative  Analysis  on  the  Operational  Impact  of  Using  Acute  Exposure  Guideline  Levels  versus  Dosage  Levels  in 
Making  Protective  Action  Decisions  for  the  Public. 

J.  Krause  Wilson 

Innovative  Emergency  Management 
8555  United  Plaza  Blvd.,  Ste.  100 
Baton  Rouge,  LA  70816 
(225)  952-8231  (fax  (225)  952-8122) 

Krause.Wilson@ieminc.com 

In  order  to  enhance  public  safety  surrounding  the  Chemical  Stockpile  Emergency  Preparedness  Program  (CSEPP)  sites  in  the 
continental  U.S.,  the  U.S.  Army  has  changed  the  policy  that  determines  how  exposure  to  chemical  warfare  agents  is  determined. 
Previously,  a  simple  integral  of  the  concentration  over  time  was  used  to  determine  if  the  population  exposed  to  agent  exceeded  certain 
dosage  thresholds  (No  Effects,  No  Deaths,  and  1%  Lethality).  The  Environmental  Protection  Agency  (EPA)  has  adopted  a  different 
standard  called  Acute  Exposure  Guideline  Levels  that  is  based  on  duration  of  exposure  to  critical  concentrations.  The  Army  has  determined 
this  approach  to  be  better  as  well.  The  approach  more  accurately  determines  what  the  medical  impacts  exposed  populations  might  have  due 
to  the  agent  by  taking  into  account  not  only  the  amount  of  exposure,  but  the  rate  at  which  the  population  was  exposed.  The  analysis 
presented  here  will  illustrate  some  of  the  operational  impacts  that  this  transition  will  have  on  the  CSEPP  communities  using  a  risk-based 
simulation  suite. 
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Is  it  Time  for  Strategic  Stability  Measures  to  Evolve  or  Disappear? 

Dr.  Robert  Batcher 

US  Department  of  State  VC/TA 
2201  C  Street  NW 
Washington  DC  20520 
202-736-7396 
batchero  @acda.  bov 

Abstract  unavailable  at  printing. 


Optimal  Strategies  for  Multipolar  Nuclear  Warfighting 

Dr.  Jerome  Bracken 

US  Department  of  State  VC/TA 
2201  C  Street  NW 
Washington  DC  20520 

The  objective  is  to  determine  allocation  of  the  weapons  of  three  sides  to  counterforce,  countervalue  and  withhold  in  a 
three-stage  nuclear  war.  The  factors  considered  are  number  of  weapons,  number  of  weapons  that  are  vulnerable,  number  of 
value  targets,  and  counterforce  and  countervalue  effectiveness.  A  utility  measure  is  proposed  which  reflects  forces  and  value 
surviving  at  the  end  of  the  three-stage  war.  A  robust  strategy  is  identified  for  the  first  striker  that  does  not  depend  on  which 
sides  strike  second  or  third.  Optimal  strategies  are  identified  for  the  second  and  third  strikers. 

For  representative  forces  insights  are  developed  as  to:  (1)  how  each  side  would  fare  depending  on  the  order  of  strikes  and 
(2)  how  each  side  should  allocate  his  weapons  at  each  stage.  Stability  metrics  are  proposed  and  applied.  The  impact  of 
defenses  is  investigated. 

The  Selection  of  Sites  for  Chemical  Weapons  Inspection 

Dr.  James  Bradley 

US  Department  of  State  VC/TA 

The  Chemical  Weapons  Convention  was  ratified  in  1997.  One  of  its  provisions  mandated  a  regime  of  inspections  of  a 
particular  class  of  chemical  plants  to  begin  in  2000.  However,  the  treaty  did  not  specify  exactly  how  sites  were  to  be  selected 
other  than  saying  that  the  selection  should  be  “random.”  This  presentation  will  discuss  a  methodology  the  United  States  has 
advocated  for  site  selection  and  will  discuss  progress  that  has  been  made  toward  its  adoption  by  the  OPCW. 

Structural  Factors  Shaping  the  I ndo- Pakistani  Conflict 

Dr.  Dan  Geller 

University  of  Mississippi 

This  study  explores  the  structural  factors  associated  with  the  Indo-Pakistani  conflict.  Although  every  conflict  between 
nation-states  has  its  unique  elements,  it  has  been  shown  that  the  presence  or  absence  of  certain  structural  factors  increases  the 
probability  of  violent  interaction.  Recent  scientifically  oriented  meta-analyses  have  identified  a  list  of  such  factors  based  on 
an  examination  of  hundreds  of  quantitative  empirical  studies  of  international  conflict  analyzing  patterns  of  war  from  the 
beginning  of  the  nineteenth  century  through  the  end  of  the  twentieth  century.  The  objective  of  these  meta-analyses  is  to 
produce  a  scientific  explanation  of  war  that  would  account  for  historical  wars  as  well  as  provide  a  means  for  estimating  the 
likelihood  of  future  conflicts.  This  study  examines  the  conflict  between  India  and  Pakistan  from  the  perspective  of  those 
factors  that  have  shown  consistent  correlation  with  the  onset  of  war.  The  factors  brought  to  bear  in  the  analysis  include 
geographical  contiguity,  form  of  government,  level  of  economic  development,  the  conventional  and  nuclear  capability 
balance,  and  the  presence  of  an  enduring  rivalry  between  India  and  Pakistan.  Each  of  these  factors  has  been  shown  to 
influence  the  probability  of  conflict  between  states.  The  concluding  section  of  this  study  places  these  structural  forces  within 
the  context  of  future  Indo-Pakistani  relations. 
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NPR  and  Stockpile  Life  Extension 
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Nuclear  Stability  and  Sufficiency  Today 

Dr.  David  McGarvev 

US  Department  of  State  VC/TA 
2201  C  Street  NW 
Washington  DC  20520 

During  this  period  of  transition  from  the  Cold  War,  what  are  the  key  issues  of  nuclear  stability  and  sufficiency?  Issues 
extracted  from  current  nuclear  policy  literature  and  Administration  policy  papers  are  reviewed  in  the  context  of  general 
concepts  of  stability  and  control  theory.  The  author  argues  that  multiple  failure  modes  should  be  looked  at  in  combination 
since  coupling  among  different  instability  modes  is  often  a  problem  and  that  size  matters  -stability  cannot  be  separated  from 
sufficiency.  He  also  proposes  some  guidelines  for  evaluating  force  postures  and  finds  that  non-strategic  nuclear  weapons  may 
be  more  relevant  than  strategic  nuclear  weapons  in  maintaining  stability  in  relevant  contingencies. 

Quantitative  Aspects  of  Growth  in  Nuclear  Warhead  Stockpiles 

Dr.  Frederic  Nvland 

US  Department  of  State  VC/TA 
2201  C  Street  NW 
Washington  DC  20520 

Abstract  unavailable  at  printing. 

Bridging  the  Gap  between  Quantitative  and  Qualitative  Analysis:  A  Framework  using  Nuclear 
Triangles 

MR.  Tom  Scheber 

OSD  Forces  Policy 

The  Pentagon,  Room  4B868,  Washington  DC 

703-695-5553  FAX  703-693-3000,  tscheber@mall.policv.osd.mil 

Most  analyses  of  stability  concepts  deal  exclusively  with  quantitative  stability  metrics  or  exclusively  with  qualitative 
stability  concepts.  Very  few  attempt  to  span  the  gap  and  link  both  quantitative  and  qualitative  concepts  to  provide  richer 
insights  into  stability  dynamics.  This  presentation  outlines  a  hierarchy  of  stability  concepts,  both  quantitative  and  qualitative, 
and  applies  the  stability  concepts  to  a  network  of  countries  using  “nuclear  triangles.”  The  nuclear  triangles  methodology 
analyzes  the  stability  dynamics  of  sets  of  three  countries  at  a  time  and  thereby  builds  a  display  of  the  interlocking  stability 
relationships.  The  stability  framework  and  triangles  methodology  presents  a  way  to  convey  both  quantitative  and  qualitative 
metrics  into  an  integrated  presentation  of  stability  characteristics.  The  presentation  uses  this  methodology  to  survey  the 
challenges  of  the  present  geopolitical  environment. 
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This  report  summarizes  a  three-phase  research  project  undertaken  by  the  USAF  Institute  for  National  Security  Studies  on 
behalf  of  the  Defense  Threat  Reduction  Agency  to  forecast  long-range  global  trends  affecting  arms  control  technologies.  The 
report  projects  the  international  political,  economic,  and  scientific  environments  to  the  year  2015.  It  posits  economic  and 
technological  drivers  as  shaping  the  system,  including  its  military  and  political  dimensions.  The  result  will  be  a  two-tiered 
system,  with  great  danger  arising  from  significant  proliferation  in  the  second  tier  and  the  transition  zone  between  tiers.  The 
report  next  draws  conclusions  from  this  likely  future  for  the  scope,  value,  and  practice  of  arms  control.  Arms  control  will  be 
focused  less  on  limitation  and  reduction  of  existing  weapons,  although  the  endgame  there  between  the  US  and  Russia  will 
remain  a  significant  effort.  The  focus  will  shift  to  the  less  well-defined  realm  of  counter-proliferation,  and  to  marginal,  failing 
and  failed  states  as  well  as  non-traditional  and  non-state  actors.  New  dimensions  will  be  added,  including  control  efforts 
toward  small  arms,  advanced  conventional  weapons,  military  space,  and  information  operations.  The  report  then  extrapolates 
from  this  future  to  assess  the  likely  arms  control  technology  requirements  in  cooperative,  non-cooperative,  intrusive,  and 
non-intrusive  regimes.  The  projection  here  is  continuing  requirements  for  each  of  these  specialized  sets  of  technologies,  with 
particular  emphasis  on  multiple-use  technologies  fro  remote  arms  control  compliance  and  verification  monitoring  as  well  as 
for  intelligence  detection  and  collection.  Similarly,  area  arms  control  monitoring  systems  must  be  capable  of  application  for 
force  protection  applications.  Data  Management/knowledge  management  will  become  a  top  priority  for  arms  control,  as  will 
the  continuing  development  of  human  expertise  in  this  advanced  area  of  specialization. 

Lessons  Learned  from  U.S.  Counterproliferation  Counterforce  Operations 
Dr.  Forrest  Waller 

Abstract  unavailable  at  printing. 
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Strategic  Anti-missile  Attrition  Zone  (SAAZ)  Defense 

Michael  A.  Bressler 

1660  Jeb  Stuart  Road 
Ft.  Bliss,  TX  79916-6816 
915-568-2185/2184 
bresslermichael@otc.armv.mil 

"  The  Department  last  year  conducted  extensive  and  rigorous  missile  defense  reviews  to  determine  how  best  to  fulfill  the 
Nation's  need  to  defend  the  U.S.,  deployed  forces,  allies  and  friends  .  The  findings  underscore  the  importance  of  layered 
defenses  as  well  as  the  need  for  new  approaches  to  acquire  and  deploy  missile  defenses.  My  objectives  are: 

•  Establish  a  single  program  to  develop  an  integrated  system  under  a  newly  titled  Missile  Defense  Agency  (MDA). 

•  Assign  the  best  and  brightest  people  to  this  work. 

•  Apply  a  capability-based  requirements  process  for  missile  defense. 

•  Direct  the  MDA  to  develop  the  missile  defense  and  baseline  the  capability  and  configuration  of  its  elements  and 
Military  Departments  to  procure  and  provide  for  operation  and  support. 

•  The  full  and  cooperative  efforts  of  the  Services,  Joint  Staff,  and  defense  agencies  are  essential  to  this  goal." 

-  Donald  Rumsfeld,  Secretary  of  Defense  (  MEMO  of  2  January  2002) 

This  is  a  concept  paper  which  will  do  away  with  conventional  thinking  and  structure  a  practical  approach  to  the 
quagmire  of  uncertainties  associated  with  a  national  missile  defense.  It  will  key  into  the  Defense  Secretary's  desire  to  explore 
new  approaches,  think  beyond  the  conventional,  and  attempt  "out-of-the-box"  vision.  It  will  advance  a  notion  of  shared  cost 

-  shared  responsibility  among  all  the  Armed  Services  making  use  of  all  the  good  and  valuable  work  heretofore  accomplished 
by  an  unprecedented  Government  /  Contractor  effort.  The  paper  will  be  an  attempt  to  kick-start  thinking  and  provoke 
questions  in  response  to  the  Secretary's  2  January  "guidance"  memorandum  that  clearly  challenges  us  all  to  revitalize  our 
thinking. 

The  Secretary  further  underscores  the  need  for  both  "international  participation"  and  the  "Military  Departments  to 
provide  forces,  as  needed,  to  support  the  fielding  of  early  and/or  contingency  capability  and  will  budget  the  resources  to 
procure  and  operate  the  planned  force  structure". 

In  addition,  the  Secretary's  second  of  four  top  priorities  makes  a  point  of  being  able  to: 

"employ  a  Ballistic  Missile  Defense  System  that  layers  defenses  to  intercept  missiles  in  all  phases  of  their  flight  (i.e.,  boost, 
midcourse,  and  terminal)  against  all  ranges  of  threats." 

The  paper  will  expand  on  the  notion  of  a  zone  defense  that  addresses  the  above  points  made  by  the  Secretary.  Since  the 
paper  is  a  concept  idea  only  certain  assumptions  will  be  made  at  the  onset  which  adhere  to  the  Secretary's  guiding  principles. 
Three  of  the  more  important  assumptions  are: 

-  Assumption  #1.  That  where  the  missile  defense  objectives  are  in  conflict  with  treaty,  defense  objectives  will  take 
precedence. 

-  Assumption  #2.  That  unconventional  thinking  will  apply  to  multi-service  procurement  and  where  ever  possible  economy 
of  acquisition  and  requirements  will  govern. 

-  Assumption  #3.  That  flexibility  will  be  the  hallmark  of  implementation  overriding  political  bickering  and  prima-donna 
attitudes. 

The  paper  will  conclude  with  a  hypothetical  war  scenario  taking  place  in  the  year  2025  which  calls  into  play  a  smooth 
working  relationship  of  all  the  Services  including  the  U.S.  Coast  Guard. 
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Combat  Identification  (CID)  Vignette  Tool 
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Despite  a  general  recognition  of  the  importance  of  CID  in  military  operations,  few  modeling  tools  make  much  of  an 
effort  to  represent  the  CID  process.  Those  modeling  tools  that  do  address  CID  typically  treat  only  a  limited  portion  of  the 
problem.  For  example,  most  models  currently  divide  the  problem  into  only  two  types  of  targets  -  friends  and  hostiles. 
However,  there  is  a  requirement  that  real  world  operations  must  perform  discrimination  between  friends,  hostiles  and 
neutrals.  Because  the  Joint  Theater  Air  and  Missile  Defense  Organization  (JTAMDO)  was  tasked  to  assess  CID 
requirements,  JTAMDO  needed  an  analytical  tool  to  facilitate  its  evaluations.  The  limitations  of  current  models  led 
JTAMDO  to  sponsor  the  development  of  a  new  analytical  tool  that  could  evaluate  both  current  and  possible  future  CID 
operations. 

The  JTAMDO  sponsored  CID  model  is  called  the  Vignette  Tool  (VT)  because  it  evaluates  the  ability  of  the  family  of 
blue  systems  to  develop  target  identification  against  a  single  target  at  a  time.  Repeated  runs  of  the  VT  allow  one  to  evaluate 
the  CID  process  throughout  an  entire  theater.  The  VT  supports  evaluations  of  multiple  types  of  targets,  ID  sensor  fusion 
techniques,  levels  of  ID  sensor  performance,  etc.  The  VT  provides  tabular  and  graphical  outputs  of  the  probability  of 
correctly  and  incorrectly  declaring  IDs  as  targets  progress  through  a  theater.  This  presentation  describes  the  numerous 
capabilities  included  in  the  VT. 
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An  important  measure  of  effectiveness  for  the  Ballistic  Missile  Defense  System  (BMDS)  is  the  area  over  which  that 
system  achieves  a  given  Probability  of  Engagement  Success  (PES)  against  each  missile  in  a  raid  of  a  given  size.  For  BMDS 
concepts  engaging  in  midcourse  using  off-board  sensors  for  data  collection  and  homing  kill  vehicles  for  target  destruction, 
the  PES  may  be  estimated  as  the  product  of  relevant  availabilities  and  reliabilities  of  the  elements  and  the  probabilities  of 
success  in  each  of  the  engagement  functions:  Detection ,  Track  [and  Correlation ],  [Resolution  and]  Discrimination,  Handover 
(Seeker  Acquisition  and  Kill  Vehicle  Divert),  Designation,  and  Hit.  The  Probability  of  Designation  as  the  probability  that  the 
kill  vehicle  can  find,  among  the  many  objects  that  may  surround  the  target,  the  one  that  the  external  sensors  have  identified 
for  it.  This  paper  derives  the  Probability  of  Designation  under  these  general  assumptions:  the  warhead  is  in  a  cloud  of 
objects  with  a  specified  distribution  of  drift  velocities  in  three  dimensions,  the  on-board  sensor  and  seeker  errors  are 
normally  distributed,  and  the  engagement  geometries  are  known.  The  paper  shows  how,  for  the  special  case  of  spherical  drift 
rates  and  spherical  track  errors,  a  map  of  the  probability  of  designation  can  be  generated  rapidly  for  different  times  since 
object  release  and  for  different  sizes  of  the  track  error,  without  the  necessity  of  many  time-consuming  numerical  integrations 
or  Monte-Carlo  runs. 
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As  both  communications  bandwidth  increases  and  computing  capability  continues  to  become  more  sophisticated,  the 
ability  to  share  information  and  resource  states  across  platforms  in  real  time  becomes  more  realizable.  Thus,  the  potential  for 
a  complete  realization  of  the  vision  of  Network  Centric  Warfare  comes  closer  to  reality.  With  these  advances  and  the 
constantly  evolving,  more  dangerous  threats,  the  need  for  multi-platform  Distributed  Weapon  Control  (DWC)  becomes 
inevitable.  DWC  consists  of  three  components,  namely,  Threat  Assessment,  Sensor  Coordination  and  Engagement 
Coordination.  Engagement  Coordination  is  the  utilization  of  forces,  networked  information  and  resources  in  a  more  effective 
way  to  defeat  the  enemy  and  is  the  topic  of  interest  in  this  brief. 

The  High  Performance  Distributed  Computing  (HiPer-D)  laboratory  is  a  real-time  laboratory  located  in  Dahlgren 
Virginia  where  multiple  Aegis  tactical  system  platforms  are  prototyped  in  order  to  demonstrate  proofs  of  concepts  with 
respect  to  advanced  computing  architecture  and  algorithm  development.  There  it  was  shown  that  a  multi-objective  algorithm 
could  make  a  decision  in  a  tactical  environment  in  real-time  by  sharing  fire  control  information  across  Aegis  platforms.  The 
next  phase  was  to  show  value  added  to  the  battlegroup.  This  brief  describes  the  current  Engagement  Coordination  schemes 
in  the  Navy  Fleet  today.  It  then  demonstrates  through  modeling  how  using  shared  high  fidelity  fire  control  information, 
platform  state  information  across  platforms  and  a  multi-objective  decision  algorithm  can  improve  battlegroup  effectiveness. 
The  focus  of  this  brief  is  to  show  the  value  added  using  a  multi-objective  decision  algorithm  to  select  the  shooter  over  the 
current  Engagement  Coordination  schemes  used  in  the  Navy  fleet  today.  Additional  discussion  includes  how  this 
methodology  can  be  extended  to  other,  non-Aegis  platforms  due  to  the  generic  criteria  and  required  interfaces. 
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The  Air  Force  Satellite  Control  Network  (AFSCN)  is  a  global,  ground  -  based  configuration  of  satellite  command, 
control  and  communications  resources  dedicated  to  supporting  our  nation’s  space  program  (i.e.  Department  of  Defense  and 
other  assigned  space  missions).  The  AFSCN  coordinates  the  use  of  fifteen  common  user  Automated  Remote  Tracking 
Stations  antennas  to  support  over  100  on-orbit  satellites.  Each  satellite  has  a  required  number  of  contacts  per  day  and 
duration  of  each  contact.  Also,  the  satellites’  known  orbits  predetermine  their  visibilities  with  each  of  the  antennas.  This 
large  number  of  current  resources,  the  constantly  expanding  role  of  space  in  military  operations,  and  National  policy  issues 
make  the  management  of  these  resources  an  increasingly  complex  issue. 

The  50th  Space  Wing  (50  SW)  operates  and  manages  all  AFSCN  resources.  In  order  to  deal  with  the  growing 
complexity,  the  Directorate  of  Plans  and  Programs  50SW  would  like  a  planning  tool  to  answer  resource  allocation  questions. 
For  example,  do  we  have  enough  ground  equipment  to  support  current  and  future  on-orbit  satellites?  Where  should  we  locate 
future  ground  systems  to  support  the  satellites?  What  are  feasible  locations  if  the  AFSCN  has  operational  restrictions  in  the 
CONUS? 

Several  efforts  (by  Gooley,  Schalck,  Burrowbridge  et  al,  and  Crowder  and  Mehlberg)  have  produced  excellent  results 
where  specified  scheduling  requests  are  input  by  each  satellite  program.  Yet  there  has  been  little  work  done  on  a  less 
restricted  problem,  where  satellite  managers  request  only  frequency,  separation,  and  duration  of  satellite  supports. 

We  model  this  problem  as  a  scheduling  problem  where  we  allocate  antennas  to  satellites.  We  exploit  the  problem 
structure  to  create  tractable  optimization  models. 


The  Ground  Moving  Target  Indicator  (GMTI)  Analysis  of  Alternatives  (AoA)  Accreditation  Process 


Paul  A.  Bave 

AFSPC  Space  Analysis  Center 
HQ  AFSPC/XPY A,  150  Vandenburg  St.  Suite  1 105 
Peterson  AFB,  CO  80914-4650 
(719)  550-5623  FAX:  (719)550-5638 
Paul.bave@peterson.af.mil 


Lynda  Liptak 

Office  of  Aerospace  Studies 
AFMC/OAS 

Kirtland  AFB,  NM  87117 

(505)  846-8312  FAX:  (505)  846-5558 

Lvnda.Liptak@kirtland.af.mil 


The  GMTI  AoA  is  being  conducted  by  the  Air  Force  Space  Command  (AFSPC)  Space  Analysis  Center  (ASAC)  to 
support  AFSPC/DR  in  their  requirements  definition  process  for  the  acquisition  of  a  space-based  radar,  or  an  equivalent 
technology,  that  will  provide  GMTI  information  to  the  combatant  commands.  The  AoA  will  use  a  number  of  models  and 
simulations  to  assess  the  military  utility  of  each  of  the  alternatives.  In  order  for  the  decision-makers  to  have  confidence  in  the 
results  produced  by  the  M&S,  and  ultimately  the  AoA,  an  accreditation  is  being  accomplished  to  judge  if  the  models  are 
“good  enough”  to  support  the  required  decisions.  The  accreditation  process  defined  for  this  AoA  is  the  first-ever  conducted 
by  AFSPC,  and  will  serve  as  the  pathfinder  for  future  AoA’s  conducted  by  the  ASAC  for  the  Command’s  decision-makers. 
This  presentation  will  describe  that  accreditation  process  and  the  specifics  of  the  plan  set  forth  for  the  accreditation  of  the 
models  to  be  used  for  the  AoA. 
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Strategic  Anti-missile  Attrition  Zone  (SAAZ)  Defense 

Michael  A.  Bressler 

1660  Jeb  Stuart  Road 
Ft.  Bliss,  TX  79916-6816 

9 1 5-568-2 1 85/2 1 84  bresslermichael@otc.army.mil 

"  The  Department  last  year  conducted  extensive  and  rigorous  missile  defense  reviews  to  determine  how  best  to  fulfill  the 
Nation's  need  to  defend  the  U.S.,  deployed  forces,  allies  and  friends  .  The  findings  underscore  the  importance  of  layered 
defenses  as  well  as  the  need  for  new  approaches  to  acquire  and  deploy  missile  defenses.  My  objectives  are: 

•  Establish  a  single  program  to  develop  an  integrated  system  under  a  newly  titled  Missile  Defense  Agency  (MDA). 

•  Assign  the  best  and  brightest  people  to  this  work. 

•  Apply  a  capability-based  requirements  process  for  missile  defense. 

•  Direct  the  MDA  to  develop  the  missile  defense  and  baseline  the  capability  and  configuration  of  its  elements  and  Military 
Departments  to  procure  and  provide  for  operation  and  support. 

•  The  full  and  cooperative  efforts  of  the  Services,  Joint  Staff,  and  defense  agencies  are  essential  to  this  goal." 

-  Donald  Rumsfeld,  Secretary  of  Defense  (  MEMO  of  2  January  2002) 

This  is  a  concept  paper  which  will  do  away  with  conventional  thinking  and  structure  a  practical  approach  to  the 
quagmire  of  uncertainties  associated  with  a  national  missile  defense.  It  will  key  into  the  Defense  Secretary's  desire  to  explore 
new  approaches,  think  beyond  the  conventional,  and  attempt  "out-of-the-box"  vision.  It  will  advance  a  notion  of  shared  cost 
-  shared  responsibility  among  all  the  Armed  Services  making  use  of  all  the  good  and  valuable  work  heretofore  accomplished 
by  an  unprecedented  Government  /  Contractor  effort.  The  paper  will  be  an  attempt  to  kick-start  thinking  and  provoke 
questions  in  response  to  the  Secretary's  2  January  "guidance"  memorandum  that  clearly  challenges  us  all  to  revitalize  our 
thinking. 

The  Secretary  further  underscores  the  need  for  both  "international  participation"  and  the  "Military  Departments  to 
provide  forces,  as  needed,  to  support  the  fielding  of  early  and/or  contingency  capability  and  will  budget  the  resources  to 
procure  and  operate  the  planned  force  structure". 

In  addition,  the  Secretary's  second  of  four  top  priorities  makes  a  point  of  being  able  to:  "employ  a  Ballistic  Missile 
Defense  System  that  layers  defenses  to  intercept  missiles  in  all  phases  of  their  flight  (i.e.,  boost,  midcourse,  and  terminal) 
against  all  ranges  of  threats." 

The  paper  will  expand  on  the  notion  of  a  zone  defense  that  addresses  the  above  points  made  by  the  Secretary.  Since  the 
paper  is  a  concept  idea  only  certain  assumptions  will  be  made  at  the  onset,  which  adhere  to  the  Secretary's  guiding  principles. 
Three  of  the  more  important  assumptions  are: 

Assumption  #1.  That  where  the  missile  defense  objectives  are  in  conflict  with  treaty,  defense  objectives  will  take 
precedence.  Assumption  #2.  That  unconventional  thinking  will  apply  to  multi-service  procurement  and  where  ever  possible 
economy  of  acquisition  and  requirements  will  govern.  Assumption  #3.  That  flexibility  will  be  the  hallmark  of 
implementation  overriding  political  bickering  and  prima  donna  attitudes. 

The  paper  will  conclude  with  a  hypothetical  war  scenario  taking  place  in  the  year  2025  which  calls  into  play  a  smooth 
working  relationship  of  all  the  Services  including  the  U.S.  Coast  Guard. 

USSPACECOM  BMD  Threat-Mission  Study 

LTC  Patrick  DuBois,  Sr.  OR  Analyst 

Analysis  Directorate,  US  Space  Command 

250  S.  Peterson  Blvd.,  Rm.  105,  Peterson  AFB,  CO.  80914 

719-554-2495  (office)  719-554 

The  Unified  Command  Plan  (UCP)  tasks  the  United  States  Space  Command  (USSPACECOM)  to  “plan  for  and  develop 
requirements  for  strategic  ballistic  missile  defense,  space-based  support  for  tactical  ballistic  missile  defense  and  space 
operations.”  USSPACECOM/J5B  has  the  command  lead  to  identify  warfighter  strategic  BMD  requirements  and  inscribe 
them  into  the  BMD  CRD.  USSPACECOM/J5B  tasked  USSPACECOM/ AN  to  assist  in  providing  analytical  rigor  to  support 
(substantiate  and  verify)  the  command’s  warfighter  BMD  requirements  delineated  in  the  BMD  CRD.  To  satisfy  the  tasking, 
USSPACECOM/AN  performed  analysis  to  substantiate  and  verify  the  missions,  roles,  architectures,  performance 
requirements,  and  operational  concepts  described  in  the  Ballistic  Missile  Defense  (BMD)  Capstone  Requirements  Document 
(CRD).  The  background,  methodology  and  the  results  of  this  analysis  (called  the  Threat-Mission  Study)  will  be  presented. 
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US  Army  Space  Modeling  and  Simulation  (M&S)  Focus  Area  Collaborative  Team  (FACT) 

Steven  R.  Elliott,  Jr. 

US  Army  Space  and  Missile  Defense  Command 
PO  Box  1500,  ATTN:  SMDC-BL-SS 
Huntsville,  AL  35807 

256-955-5315  -  Phone  256-955-5136  -  Fax,  Steven. elliott @ smdc . army . mi  1 

The  Army  Space  Modeling  &  Simulation  (M&S)  Focus  Area  Collaborative  Team  (FACT)  was  convened  in  response  to 
a  Department  of  the  Army,  Deputy  Chief  of  Staff  for  Operations  and  Plans  (DA-DCSOPS)  tasker  directed  by  the  Vice  Chief 
of  Staff  Army  (VCSA)  during  the  Space  Force  Management  Analysis  (FORMAL)  Review  on  4  September  2001.  The  Space 
FORMAL  Review  recognized  that  Army  Space  requirements  and  capabilities  are  not  captured  in  current  models  and 
simulations.  As  a  result,  there  are  no  robust  analyses  to  support  space  acquisition  and  develop  space  requirements.  The 
members  of  the  review  also  noted  that  the  training  of  space  battle  staffs  is  lacking.  The  Space  M&S  FACT  is  to  present  a 
coordinated  space  M&S  roadmap  recommendation  to  the  Army  Models  and  Simulations  Executive  Council  (AMSEC)  during 
their  Fall  2002  meeting. 

SBIRS  Increment  1:  An  Initial  Look  at  the  Results  of  Fusing  Space-Based  Infrared  Data  at  the 
Mission  Control  Station 

Cherie  Gott 

HQ  NORAD/USSPACECOM  ANA 
250  South  Peterson  Blvd.,  Suite  105 
Peterson  AFB,  CO  80914-3180 

Voice:  719-554-3945  Fax:  719-554-5068,  Cherie.gott@peterson.af.mil 

Declaration  of  Initial  Operating  Capability  (IOC)  for  Increment  1  processing  of  DSP  data  at  the  SBIRS  Mission  Control 
Station  (MCS)  occurred  in  mid-December  2001.  SBIRS  Inc.  1  processing  delivers  significant  improvements  for 
strategic/space  launch  and  in-flight  parameter  estimates  as  a  result  of  fusing  available  space-based  infrared  (IR)  data.  This 
type  of  fused  data  product  has  been  providing  enhanced  warning  of  theater  launch  data  since  the  early  1990s  when  ALERT 
(Attack  and  Launch  Early  Reporting  to  Theater)  was  formed  to  provide  more  accurate,  timely  launch  data  to  the  theater.  This 
capability  has  been  extended  to  strategic  and  space  launch  events  with  SBIRS  Increment  1  processing. 

The  SBIRS  MCS  started  Initial  Operations  Evaluation  &  Testing  (IOT&E)  in  early  June  2001.  Since  mid-September 
2001,  strategic  and  tactical  missile  launch  messages  from  the  MCS  have  been  available  to  forward  users  via  their  respective 
broadcasts.  In  the  Analysis  Directorate  at  HQ  NORAD/USSPACECOM,  we  have  been  quantifying  the  accuracy  and 
timeliness  of  this  forward-user  data.  On-going  monthly  performance  statistics  are  being  generated  to  gauge  the  performance 
of  the  MCS  with  reference  to  existing  legacy  strategic  and  theater  processing  centers,  as  well  as  with  reference  to  best- 
estimate  ‘truth  data’. 

This  presentation  will  focus  on  the  comparison  and  improvements  noted,  specifically  in  strategic/space  launch 
parameters  compared  against  legacy  monocular  reporting  sites.  We  will  also  present  a  comparison  of  SBIRS  theater  data 
against  the  baseline  established  by  ALERT  -  the  legacy  theater  processing  element  upon  which  the  SBIRS  Increment  1 
processing  component  was  initially  established. 

Initiatives  of  the  AFSPC  Space  Analysis  Center 

Col  T.  S.  Kelso.  USAF 

AFSPC/XPY,  150  Vandenberg  St,  Suite  1 105 
(719)  554-9801,  Fax:  (719)554-5119 
TS.Kelso@peterson.af.mil 

Air  Force  Space  Command  (AFSPC)  stood  up  its  new  Space  Analysis  Center  (AS  AC)  on  31  Aug  2001.  The  AS  AC  is 
the  Air  Force  center  of  excellence  for  space-oriented  analysis,  whose  vision  is  “Shaping  national  space  capabilities  through 
analysis.’’  The  ASAC’s  mission  is  to  conduct  analysis  across  all  AFSPC  mission  areas  in  support  of  requirements  generation, 
planning  &  programming,  acquisition,  operations,  and  support  by:  (1)  assessing  military  utility  of  space  and  missile  systems, 
(2)  improving  operational  space  capabilities,  (3)  quantifying  space  effects  in  exercises  and  wargames,  and  (4)  acting  as  a  key 
analysis  focal  point  for  collaboration  within  the  national  security  space  community.  The  ASAC  faces  several  challenges  in 
providing  analysis  to  support  the  AFSPC  Integrated  Planning  Process,  in  constructing  a  robust  M&S  toolkit  for  analysis  and 
ensuring  space  is  properly  represented  in  joint  and  AF  models,  in  developing  a  long-range  research  investment  plan,  and  in 
adapting  its  mission  and  operating  concept  to  match  the  changes  in  DoD  as  a  result  of  the  Air  Force  being  designated 
Executive  Agency  for  Space.  This  presentation  will  provide  an  update  and  status  report  on  the  purpose,  progress,  and 
initiatives  of  the  ASAC;  seek  interaction  with  others  in  the  space  MS&A  community;  and  build  coordinated  support  for 
advancement  of  the  space  MS&A  community’s  joint  goals. 
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An  Agent-Based  Modeling  Approach  to  Measuring  the  Value  of  a  Proposed  Information  System 

MAJ  Robert  H.  Kewlev 

US  Army  Command  and  General  Staff  College 
US  Student  Division 
Fort  Leavenworth,  KS  66027 
931-680-0050,  Robert .  kewlev  @  us .  army  .mil 

For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness 
of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  the 
extent  to  which  these  systems  increase  combat  effectiveness.  This  paper  describes  a  methodology  we  chose  to  investigate 
whether  an  agent-based-model  (ABM)  could  be  used  to  suggest  appropriate  behaviors  for  a  combat  force  equipped  with  a 
proposed  information  system  such  as  Future  Battle  Command  Brigade  and  Below  -  FBCB2.  The  decision  agents  within  the 
model  will  use  the  information  about  enemy  forces,  friendly  forces,  and  terrain  provided  by  the  proposed  information  system 
to  adjust  the  friendly  course  of  action  to  the  updated  situation.  Our  methodology  is  a  three-step  process.  We  first  execute 
simulation  runs  using  an  existing  dynamic  study  scenario  and  evaluate  the  results  of  these  runs.  In  the  second  step,  we 
transfer  the  terrain,  units,  and  course  of  action  from  the  existing  dynamic  scenario  to  an  ABM  with  intelligent  agents  that  will 
refine  the  course  of  action  genetic  algorithm  by  generating  new  unit  positions  and  routes  based  upon  the  current  situation.  In 
the  final  step,  we  substitute  the  ABM  developed  course  of  action  and  behaviors  back  into  the  dynamic  study  scenario  and 
execute  another  set  of  simulation  runs.  The  performance  of  the  friendly  force  using  the  proposed  information  system  and 
ABM  generated  behaviors  may  be  compared  to  the  performance  of  the  friendly  force  which  failed  to  take  advantage  of 
current  information.  This  gives  insight  into  the  potential  increase  in  combat  effectiveness  realized  through  the  use  of  an 
information  system. 

Joint  Global  Positioning  System  Combat  Effectiveness  (JGPSCE)  Joint  Test  and  Evaluation  (JT&E) 

Capt  Michael  W.  Kram  USAF 

JGPSCE  JTF 

2050  2nd  Street,  SE 

Kirtland  AFB,  NM  87117-5669 

Commercial  Phone:  505-846-2811,  FAX:  505-853-1974 

Email:  michael.kram@afotec.af.mil 

On  29  July  1999,  the  Office  of  the  Secretary  of  Defense  (OSD),  Deputy  Director,  Developmental  Test  and  Evaluation 
(DD,  DT&E),  Strategic  and  Tactical  Systems  (S&TS),  in  cooperation  with  the  Joint  Chiefs  of  Staff  and  Services,  chartered 
the  JGPSCE  JT&E.  Over  a  four-year  period,  the  JGPSCE  Joint  Test  Force  (JTF)  is  conducting  a  series  of  test  events  that 
focus  on  joint  operations  where  the  Global  Positioning  System  (GPS)  is  denied  or  degraded  by  hostile  electronic  warfare 
(EW)  or  friendly  electromagnetic  interference  (EMI).  Specifically,  the  JGPSCE  JT&E  is  addressing  the  following  issues: 

Issue  I:  What  is  the  impact  of  GPS  vulnerabilities  on  the  effectiveness  of  joint  operational  missions  that  require  precision 
engagement? 

Issue  2:  What  changes  in  joint  tactics,  techniques,  and  procedures  (TTPs)  or  system-level  mitigation  techniques  improve  or 
maintain  joint  operational  mission  effectiveness  in  the  event  of  GPS  EW  and  EMI? 

Issue  3:  What  test  methodologies  can  be  employed  to  characterize  GPS  vulnerabilities  in  future  acquisition  and  integration 
programs? 

The  JGPSCE  JTF  conducted  its  second  field-test — GYPSY  BRAVO — from  11  Jan  02  through  25  Jan  02  at  Fallon  NAS, 
NV.  GYPSY  BRAVO  test  participants  included  Air  Force  F-16C  Operational  Test  Crews,  Air  Force  F-15E  Operational  Test 
Crews,  Navy  and  Marine  F/A-18  Operational  Crews,  and  Army  AH-64D  Test  Crew.  Crews  conducted  interdiction  missions 
in  the  context  of  a  medium-scale  contingency  scenario.  This  presentation  will  focus  on  the  GYPSY  BRAVO  test  concept,  test 
methodology,  and  test  results. 

Measuring  the  Difference  in  Force  Effectiveness  Resulting  from  Changes  in  Information  Systems 

MAJ  Larry  R.  Larimer  Ms.  Kelaine  M.  Nick,  GS-13 

TRADOC  Analysis  Center  TRADOC  Analysis  Center 

Attn:  ATRC-WBC  Attn:  ATRC-WBC 

White  Sands  Missile  Range,  NM  88002  White  Sands  Missile  Range,  NM  88002 

(505)  678-2914;  (505)  678-8074  (505)  678-5966;  (505)  678-8074 

larimerlr@trac.wsmr.armv.mil  nickkm@trac.wsmr.armv.mil 
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For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness 
of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  how 
well  proposed  information  systems  perform. 

This  paper  describes  a  methodology  we  chose  to  assess  the  value  of  an  information  system  (Force  XXI  Battle  Command, 
Brigade  and  Below  -  FBCB2)  to  the  battlefield  decision  maker.  Our  approach  focuses  on  use  of  the  CASTFOREM  combat 
model  with  emphasis  on  tying  decisions  and  activities  to  available  information.  We  discuss  use  of  a  detailed  communications 
modeling/information  flow  capability  in  CASTFOREM,  situational  awareness  databases  at  the  platform  level,  decision¬ 
making  logic,  and  the  incorporation  of  enhanced  Combat  Service  Support  modeling  driven  by  communications  and  self- 
determined  movement  routes. 

Analytical  Support  to  the  Schriever  2002  Space  Game 

Lt  Col  Charles  Marshall 

SWC/XRV,  730  Irwin  Ave,  Ste  83 
Schriever  AFB,  CO,  80912 

Voice:  719-567-9497,  Fax:  7 19-567-9496,  Charles.Marshall@schriever.af.mil 

The  Schriever  2002  Space  Game  is  one  of  the  preeminent  space  wargames  in  the  DoD.  The  Schriever  2002  wargame 
objectives  are  to  examine  both  military  and  commercial  space  assets  in  a  2015  scenario  to:  1)  Explore  impacts  of  alternative 
space  laws,  policies  and  strategies  on  future  space  operations,  2)  examine  space  in  emerging  transformational  concepts  (Land, 
Sea,  Air,  Space  and  IO),  and  3)  Provide  insights  for  effects  based  acquisition.  A  series  of  pre-game  workshops  will  be  held 
to  examine  issues  pertinent  to  each  of  the  individual  objectives.  This  presentation  will  discuss  the  analytical  support  during 
the  pre-game,  game  and  post  game  phases  of  the  Schriever  2002  wargame.  The  analytical  methodology  centers  on  the 
development  of  a  series  of  research  questions  that  link  the  game  objectives  to  both  the  appropriate  venue  to  address  the 
research  question  (i.e.  either  a  pre-game  workshop,  the  actual  wargame,  or  both)  as  well  as  the  analytical  toolset  required  to 
perform  required  analysis  to  answer  the  research  question(s). 

Initiatives  of  The  Space  Users  Group 

Mai  Bill  McLaqan 

USSPACE/AN,  250  S.  Peterson  Blvd,  Suite  105 
Peterson  AFB,  CO  80914-3180 

719.554.5122,  FAX  719.554.5068,  bill.mclagan@peterson.af.mil 
Abstract  unavailable  at  printing. 

Quantifying  Utility  Based  on  GPS  Performance  Attribute  Values 

Kirk  Mever 

Veridian  Engineering,  Inc. 

5200  Springfield  St,  Ste.  200,  Dayton,  OH  4543 1 
937-476-2510  -  Phone  937-476-2900  -  Fax 
kirk.mever@veridian.com 

The  GPS  Performance  Attribute  Analysis  Tool  (GPAAT)  was  developed  to  compute  and  analyze  the  military  utility  of 
various  GPS  performance  attributes,  such  as  availability,  accuracy,  integrity,  and  received  signal  power.  This  framework  has 
been  built  to  assist  in  the  determination  of  GPSIII  design  specifications  by  calculating  and  analyzing  the  linkages  between 
specific  system  Performance  Attributes  and  operational  Measures  of  Merit.  GPAAT ’s  construct  is  modeled  around  the 
complete  “strategy-to-task”  decomposition  of  Joint  Vision  2020.  GPS  performance  attribute  values  are  used  to  calculate 
Measures  of  Performance  (MOP),  such  as  navigation  error  and  CEP  for  use  cases  within  the  JV2020  decomposition. 
GPAAT  provides  traceability  from  MOPs  to  Measures  of  Utility  (MOU),  including  Measures  of  Effectiveness  (MOE)  and 
Measures  of  Outcome  (MOO).  This  tool  determines  performance-cost  trades  for  military  operations  by  analyzing  the  cause- 
effect  relationship  between  performance  attributes  and  cost.  This  analysis  approach  will  enable  military  decision  makers  to 
quantify  the  benefits  associated  with  improving  specific  performance  attribute  values.  The  presentation  includes  an  outline 
of  the  tool  structure  and  flow,  a  sample  scenario  of  military  use  cases,  and  utility  analysis. 
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Space  Based  Radar  -  the  Warfighter’s  Perspective 


Steve  F.  Pierce 

Chief,  Space  Studies  and  Analysis 
SMDC 

106  Wynn  Drive.  PO  Box  1500 
Huntsville,  AL  35807 

(256)955-1937  DSN  645-2377  Fax  (256)955-2250 


Martin  Goodman 

Engineer,  Space  Studies  and  Analysis 
SMDC 

106  Wynn  Drive.  PO  Box  1500 
Huntsville,  AL  35807 

(256)955-1937  DSN  645-1937  Fax  (256)955-2250 


DoD  Joint  C4ISR  Decision  Support  Center  sponsored  a  Force-on-Force  Analysis  conducted  by  Space  and  Missile 
Defense  Battle  Labs  (SMDBL)  Studies  and  Analysis  Division.  Results  contributed  to  the  overall  DSC  study  submission 
during  the  Milestone-A  or  DSAE  review.  The  SMDBL  Study  was  a  constructive  analysis  utilizing  Satellite  Toolkit  (STK), 
JANUS  and  System  Effectiveness  Analysis  Simulation  (SEAS)  to  determine  the  utility  of  Space  Based  Radar  (SBR)  to  the 
Warfighter  in  the  close  and  deep  fight.  The  timeframe  of  the  analytical  fight  was  2008-2010.  EEAs  included  Blue  force 
effectiveness  with  and  without  SBR,  Blue  force  effectiveness  with  LEO  versus  MEO  SBR  architectures,  and  Blue  force 
effectiveness  sensitivity  to  SBR  timeliness.  The  study  used  an  approach  that  was  architecturally  neutral. 


Arnold  Engineering  Development  Center  (AEDC)  Space  Presence  Review  Team  (SPRT)  - 
Developing  a  Space  Test  and  Evaluation  Strategic  Plan 


David  W.  Pruitt,  PhD 

Sverdrup  Technology,  Inc. 

939  Avenue  C,  Arnold  AFB,  TN  37389-9900 

dave.pruitt@arnold.af.mil 

93 1  -454-3 1 30  (DSN  340-)  93 1  -454-46 1 1  FAX 


Kevin  L.  Gooder 

Senior  Manager,  Test  Facility  Planning 
AEDC/XPX,  Arnold  AFB,  TN.  37389 
kevin.gooder@arnold.af.mil 
931-454-6507  (DSN  340-)  931-454-6254  FAX 


Thomas  T.  DeLaCruz 

Scitor  Corporation 

1250  Academy  Park  Loop,  Suite  208 

Colorado  Springs,  CO.  80910 

719-637-6624,719-637-6601  FAX,  tdelacruz@scitor.com 


Lance  E.  Baxter,  Capt,  USAF 

Deputy  Chief,  Space  Testing 

Arnold  Engineering  Development  Center 

lance.baxter@arnold.af.mil 

931-454-5357  (DSN  340-)  931-454-6348  FAX 


Unprecedented  events  are  now  occurring  in  the  DoD  Test  and  Evaluation  (T&E)  world.  Many  of  these  events  are 
spawned  by  the  evolution  of  near-earth  space  as  a  theater  of  war.  The  DoD  has  a  clearly  stated  goal  of  developing  the 
technologies,  doctrine,  and  systems  to  ensure  US  dominance  of  the  Space  Theater.  In  the  near-term,  the  actions  of  the 
Rumsfeld  space  commission  aimed  toward  this  goal  will  have  significant  impact  on  space  T&E  operations  at  AFMC,  and 
how  AFMC  supports  AFSPC.  In  the  far-term,  space  T&E  will  likely  undergo  an  even  more  profound  change.  In  order  for 
the  DoD  to  be  prepared  to  test  space  systems  required  to  meet  the  demands  of  US  national  security,  steps  to  understand  those 
requirements  and  assess  capabilities  against  T&E  needs  must  be  taken. 

Events  happening  within  the  last  few  months  at  the  AFMC,  AF,  and  OSD  levels,  including  transfer  of  the  Space  Single- 
Face-to-Customer  (SFTC)  office  from  SMC/TE  to  Arnold  Engineering  Development  Center  (AEDC),  reorganization  of  SMC 
to  AFSPC,  and  the  call  for  an  umbrella  space  test  organization  from  the  OSD  CTEIP  office,  emphasize  the  need  for  action  at 
this  time.  The  Space  Presence  Review  Team  (SPRT)  is  taking  action  to  ensure  space  T&E  needs  are  met. 

Acting  under  the  SFTC  responsibility,  the  Arnold  Engineering  Development  Center  (AEDC)  is  undertaking  a  strategic 
planning  effort  to  assess  future  requirements  for  the  Department  of  Defense  (DoD)  space  test  capabilities.  AEDC  has 
organized  the  SPRT,  which  is  a  team  comprised  of  representatives  from  across  the  DoD  space  community.  The  SPRT  will 
identify  shortfalls  and  recommendations  and  develop  a  process  to  compare  space  test  investment  options.  This  process  will 
allow  appropriate  organizations  to  develop  solutions  to  meet  the  highest  priority  need. 

This  presentation  will  discuss  the  SPRT  process  and  analysis  framework  approach  to  develop  a  space  T&E  strategic  plan 
that  includes: 


a.  Develop  an  analysis  hierarchy  for  the  space  T&E  value  model.  This  will  include  gathering  of  data  to  validate 
the  hierarchy. 

b.  Define  quantitative  aspects  of  the  model.  This  includes  defining  performance  measures  and  "value"  functions, 
and  validating  the  performance  measures  and  value  functions. 

C.  Application  of  the  value  model  to  identify  space  test  limitations.  This  includes  comparing  T&E  needs  against 
national  capabilities.  This  also  includes  developing  recommendations  for  appropriate  DoD  organizations  to 
address  shortfalls  in  T&E  space  test  capabilities. 
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Developing  a  Space  Analysis  ToolKit 

Mark  D.  Reid 

Applied  Research  Associates 

1250  Academy  Park  Loop,  #235,  Colorado  Springs,  CO  80910 
719.596.9750  -  Phone  719.596.9748  -  Fax  mreid@ara.com 

The  newly  formed  AFSPC  Space  Analysis  Center  (ASAC)  is  developing  a  process  to  create  a  Space  Analysis  ToolKit 
(SATK).  In  standing  up,  the  ASAC  is  taking  a  zero-based  approach  to  building  the  right  set  of  modeling  and  simulation 
(M&S)  tools  and  their  supporting  data  with  which  to  conduct  analyses  across  all  AFSPC  mission  areas  in  support  of 
requirements  generation,  planning  &  programming,  acquisition,  operations,  and  support.  Key  to  selecting  the  right  models 
for  inclusion  in  such  a  kit  is  selection  of  appropriate  criteria  for  deciding  to  admit  candidates  to  the  toolkit.  The  ASAC’s 
criteria  set  is  based  on  a  combination  of  UJTL-linked  tasks  and  customer-driven  analytic  questions.  The  ASAC  is  applying 
lessons  learned  from  the  Air  Force’s  construction  of  its  Standard  Analysis  Toolkit,  and  previous  ASAC  experience  in 
constructing  a  suite  of  tools  used  for  the  Ground  Moving  Target  Indicator  (GMTI)  Analysis  of  Alternatives. 

While  there  are  literally  hundreds  of  different  space-oriented  models  available  within  the  space  community  which  could 
address  these  analytical  M&S  requirements,  the  ASAC  could  not  feasibly  use  or  afford  the  costs  of  development; 
verification,  validation,  and  accreditation  (VV&A);  configuration  management;  and  training  for  anything  more  than  a  small 
subset  of  these  models  and  associated  data  files.  The  ASAC  SATK  will  establish  a  minimal  but  sufficient  set  of  off-the-shelf 
M&S  tools  satisfying  the  bulk  of  the  ASAC’s  analytical  requirements.  The  tools  that  will  compose  this  SATK  must  undergo 
an  accepted  VV&A  process. 

Information  Modeling  of  Future  Technology;  Using  Complex  Adaptive  Systems  to  Model  Warfare  in 
the  21st  Century 

MAJ  David  Sanders 

Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10996 
845-938-5539  fd0357@usma.edu 

We  describe  the  modeling  of  warfare  as  a  complex  adaptive  system  with  emphasis  on  the  use  of  information  in  combat. 
Specifically,  we  address  the  ability  of  Agent  Based  Models  to  identify  complex  interactions  that  occur  with  the  use  of  new 
technologies  and  how  these  models  can  be  used  in  the  analysis  of  potential  future  weapon  systems.  We  explore  the  potential 
gains  available  in  combat  modeling  from  the  inclusion  of  complexity  in  the  modeling  process  under  the  guise  of  modeling  the 
FCS  in  an  agent  based  model. 

Go-to-War-07  A  Look  at  the  Effects  of  Digitization  on  a  Major  Theater  of  War 

MAJ  Karl  O.  Schwartz 

Center  for  Army  Analysis 
6001  Goethais  Road 
Fort  Bel  voir,  VA  22060 
703-806-5611  Fax:703-806-5727 
Schwartz@caa.army.mil 

As  the  Army  transforms  in  the  21st  Century,  we  have  relied  on  technology  to  achieve  an  edge  in  combat.  Of  specific 
interest  is  the  Command,  Control,  Communications,  Computers,  Intelligence,  Surveillance  and  Reconnaissance  (C4ISR) 
which  is  largely  assisted  by  space  based  platforms  (Global  Positioning  Systems  (GPS)  and  information  dissemination  via 
satellites).  This  focuses  technology  as  a  tool  for  the  commander  to  make  better  decisions  because  of  better/more  information. 
To  this  point,  measurements  have  been  mostly  qualitative  in  nature  (faster,  better,  more).  What  about  quantitative 
measurements?  This  presentation  seeks  to  answer  this  question  as  it  relates  to  a  major  conflict  at  the  theater  level  from  the 
aspect  of  campaign  duration,  losses  of  major  pieces  of  equipment,  and  casualties.  Additional  insights  are  also  presented  about 
the  interactions  between  digital  and  analog  forces  as  digitization  is  phased  into  the  force. 


William  B.  Carlton 
Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10996 
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Martial  Arts  Tenants:  Balance ,  FOCUS  and  Power  Applied  to  Air  Force  Space  Command’s 
Modernization  Planning  Tools 


Mr.  Michael  Tedeschi 

HQ  AFSPC/XPY A 
150  Vandenberg  Street,  Suite  1 105 
Peterson  AFB  CO  80914-4570 
(719)  554-9968 

michael.tedeschi@peterson.af.mil 


Mr.  William  C.  McIntyre  III 
HQ  AFSPC/XPY  A 
150  Vandenberg  Street,  Suite  1 105 
Peterson  AFB  CO  80914-4570 
(719)  554-9816 

william.mcintvre@peterson.af.mil 


The  HQ  AFSPC  modernization  planning  methodology  brings  to  bear  two  important  areas  of  operations  research,  multi¬ 
attribute  decision  analysis  (MOD A)  and  binary  integer  programming  (BIP).  Value  Focused  Thinking  is  used  to  create  a 
model  to  measure  the  military  value  of  space  systems.  The  scores  from  the  value  model  become  part  of  the  input  to  a  binary 
integer  program  that  seeks  to  maximize  military  value  subject  to  launch  constraints,  budget  constraints,  task  coverage,  the 
projected  times  for  systems  to  become  operational,  and  dependencies  between  systems.  The  BIP  forces  attention  to  the 
analytical  details:  mutual  exclusivity  and  collectively  exhaustive.  The  unexpected  pay  off  is  that  by  focusing  on  77 
measurable  levels  of  the  value  model,  we  can  map  200  space  systems  to  the  operational  model  of  the  day. 

Huge  strides  in  reducing  cross  command,  redundant  capabilities  are  being  taken.  We  are  now  asked  to  describe  system 
contributions  across  Air  Force  Missions  and  in  terms  that  allow  for  comparison  across  commands.  The  overarching  “models 
of  the  day”  that  we  are  asked  to  map  to  vary  annually  and  are  often  defined  in  terms  of  operations  or  missions.  These  models 
lend  themselves  to  understanding  organizational  requirements  and  perhaps  to  address  quantity  of  required  systems.  There  is 
some  chance  that  they  are  even  exhaustive  in  coverage  of  required  capabilities,  but  experience  has  shown  that  they  are  not,  by 
design,  mutually  exclusive.  For  the  last  four  years,  HQ  AFSPC  has  used  an  analytical  framework  for  modernization 
planning.  The  framework  was  originally  built  to  perform  space  system  trade-off  analysis.  It  has  proven  to  be  not  only  useful 
in  the  business  of  modernization  planning,  but  also  in  the  tedious  work  of  conforming  to  the  latest  new  paradigm. 

This  presentation  will  describe  then  discuss  how  the  balance  and  focus  of  the  AFSPC  value  model  saves  resources.  It 
will  also  illustrate  the  power  of  using  BIP  to  discover  potential  solutions  to  buy  the  most  capabilities  in  a  cost  constrained 
environment. 
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Master  Air  Attack  Plan  (MAAP)  Toolkit 

Mai  Douglas  C.  Combs 

238  Hartson  St. 

Hurlburt  Field,  FL  32544 

(850)  884-8250,  Douglas.combs@hurlburt.af.mil 

The  Master  Air  Attack  Planning  Team  develops  the  daily  aerospace  battle  plan  to  accomplish  aerospace  tasks  and 
achieve  Joint  Forces  Air  Component  Commander  objectives  in  fulfillment  of  the  Joint  Forces  Commander  mission.  It  must 
achieve  maximum  desired  effects  against  the  adversary.  The  MAAP  process  is  time  consuming  and  labor  intensive.  During 
planning,  access  to  information  such  as  weather,  threats,  and  resource  availability  is  not  readily  available  nor  is  it  presented  in 
a  manner  that  optimizes  its  near  real  time  use.  The  Command  and  Control  Battlelab’s  MAAP  Toolkit  brings  real-time 
planning  information  to  the  MAAP  Cell  in  an  operationally  friendly  way  that  expedites  MAAP  development.  Information 
feeds  include  unit  level  resource  information.  Modernized  Integrated  Database  (MIDB),  Air  Operations  Database  (AODB), 
space  planning  information  from  the  Space  Battle  Management  System  (SBMCS),  predicted  theater  wide  weather,  other 
component  plans  (ground,  air,  maritime),  the  target  nomination  list  (TNL),  and  Joint  Task  Force  (JTF)/JFACC  guidance.  The 
MAAP  Toolkit  will  electronically  build  mission/package  worksheets  and  transfer  this  information  to  TAP  via  flat-file  transfer 
without  the  need  for  human  data  entry.  This  automatic  transfer  of  data  will  dramatically  increase  manpower  effectiveness  and 
reduce  manpower  requirements  for  both  the  MAAP  Cell  and  Air  Tasking  Order  (ATO)  Production. 

U.S.  Japan  Bilateral  Study  -  Notional  Sensor  Platform 

Evan  Esaki 

Northrop  Grumman  Information  Technology,  Commander  in  Chief,  USCINCPAC 
Attn:  J081  (Mr.  Hachida)  Box  64028,  Camp  H.  M.  Smith,  HI  96861-4028 
DSN  (315)  477-6390  x  2699,  Fax  477-0245,  eesaki@vic-info.org 

USCINCPAC  is  involved  in  continuing  analysis  with  allies  in  the  Pacific  region.  Last  year,  USCINCPAC  and  the 
Japanese  Joint  Staff  Office  (JSO)  initiated  a  new  bilateral  study.  The  study  is  a  bilateral  joint  assessment  of  the  benefits 
provided  by  a  high  altitude  long  endurance  unmanned  platform  referred  to  as  a  Notional  Sensor  Platform  (NSP)  in  conducting 
maritime  surveillance  of  the  Sea  of  Japan  and  its  littorals  to  monitor  ship  traffic  and  support  humanitarian  assistance  in  natural 
disasters.  This  is  the  first  analytic  effort  involving  USCINCPAC  and  Defense  Agency,  Japan  (JDA)  since  the  Bilateral  Sea 
Lines  of  Communications  Study  was  completed  in  1987.  The  procedures  developed  during  this  study  will  provide  the  basis 
for  future  bilateral  analyses. 

NSP  provides  a  pseudo-satellite  capability  owned  at  the  operational  level.  This  provides  a  flexible  sensor  capability  that 
can  be  tasked  to  respond  to  other  requirements  such  as  natural  disasters.  The  Extended  Air  Defense  Simulation  (EADSIM)  is 
the  primary  model  for  this  analysis.  Detailed  command,  control,  and  communication  of  the  NSP  were  modeled  in  EADSIM 
to  model  the  collection,  processing  and  dissemination  of  imagery  data.  Two  different  command  and  control  structures  were 
modeled  as  well  to  measure  the  impact  of  Japanese  Maritime  Self  Defense  Force  (JMSDF)  C2  structure  compared  to  a  Joint 
C2  structure. 

NSP  may  contribute  greatly  to  collection  of  intelligence  data  for  the  Sea  of  Japan  and  its  littorals.  However,  NSP’s 
demands  on  the  regional  Intelligence,  Surveillance,  and  Reconnaissance  (ISR)  infrastructure  may  be  too  high  for  practical  use. 
This  study  will  provide  a  preliminary  assessment  of  NSP  use,  and  may  lead  to  more  detailed  analyses  if  relationships  between 
NSP  benefits  and  demands  are  favorable.  USCINCPAC  and  JSO  have  coordinated  a  plan  to  develop  the  database,  scenario, 
and  objectives;  execute  model  runs;  and  analyze  output  data. 
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This  briefing  will  provide  a  brief  description  of  the  study  objective,  scope,  approach,  methodology,  database  and 
emerging  results  of  this  effort.  This  briefing  describes  two  potential  scenarios  for  the  use  of  an  NSP:  maritime  surveillance, 
and  humanitarian  assistance  in  a  disaster.  It  concludes  with  estimates  of  NSP  benefit/demand  relationships. 


Rapid  Initialization  of  Course  of  Action  (CO A)  Tools  Using  Data  from  GCCS 


Zach  Furness 

The  MITRE  Corporation 
7515  Colshire  Dr  MS  W649 
McLean,  VA,  22102 
703-883-6614 
zfurness  @  mitre.org 


LTC  Ernie  Isensee 

Combined  Forces  Command,  USFK 

Operations  Analysis  Branch,  C3  Plans 

PSC  303  Box  27,  APO  AP  96204 

011-822-7913-8371 

isenseee@usfk.korea.armv 


LCDR  Mike  Fitzpatrick 

SPAWAR 

CODE  PMW-153 

858-537-0181 

milsfitz@spawar.navy.mil 


Over  the  past  several  years,  simulations  have  been  increasingly  used  as  a  way  of  developing  and  evaluating  courses  of 
action  (COAs)  during  staff-level  training  exercises.  However,  one  of  the  major  drawbacks  in  using  such  tools  in  the  inability 
to  rapidly  populate  such  simulations  with  data  that  exists  in  C4ISR  systems.  In  the  majority  of  instances,  unit  data  is  read 
directly  off  of  the  available  C4ISR  system  and  input  manually  into  the  COA  simulation.  This  process  can  be  time  consuming 
and  is  prone  to  errors  -  due  to  both  the  manual  nature  of  the  process  and  the  fact  that  the  tactical  picture  may  change 
significantly  by  the  time  all  the  data  has  been  input. 

During  the  Navy's  Global  '01  Wargame  last  year,  an  automated  process  for  initializing  the  Naval  Simulation  System 
(NSS)  based  directly  on  available  track  data  in  the  Global  Command  and  Control  System  (GCCS)  was  used  for  the  first  time 
in  an  exercise.  The  interface  leverages  standard  M&S  and  C4I  architectures  -  employing  components  based  on  the  DII  COE 
and  the  High  Level  Architecture  (HLA).  Use  of  this  capability  led  to  a  significant  improvement  in  the  speed  in  which  NSS 
could  be  initialized,  and  also  the  accuracy  of  the  COAs  evaluated.  Because  it  was  used  directly  by  the  NAVFOR  cell  in  the 
exercise,  it  helped  to  streamline  the  C2  decision  process  for  the  training  audience.  The  success  of  this  application  has  led  the 
Navy  to  employ  it  on  the  USS  Coronado  during  the  upcoming  Fleet  Battle  Experiment  -  Juliet  (FBE-J),  during  the  summer  of 
2002. 

This  year  the  GCCS-NSS  interface  was  extended  to  include  a  second  COA  application  -  the  Integrated  Theater 
Engagement  Model  (ITEM).  The  GCCS-ITEM  initialization  capability  will  be  used  during  exercise  Reception,  Staging,  and 
Onward  Integration  (RSOI)  in  Korea  in  the  spring  of  2002,  and  again  during  exercise  Ulchi  Focus  Lens  (UFL)  in  Korea  later 
in  2002. 

This  presentation  will  cover  lessons  learned  in  all  of  the  exercise  and  experimental  uses  outlined  above  and  discuss  future 
plans  for  both  applications.  It  will  also  discuss  potential  future  areas  involving  the  interoperability  of  C4ISR  and  M&S 
systems  that  could  significantly  improve  the  C2  decision  process. 


Development  of  the  C4ISR  Logical  Architecture  for  Network-Centric  Units 
CPT  Thomas  Glover 

TRADOC  Analysis  Center,  255  Sedgwick  Avenue,  Fort  Leavenworth,  KS  66027-2345 
(913)  684-9184,  FAX:  (913)  684-9189,  Email:  glover.thomas@trac.army.mil 

This  presentation  will  focus  on  issues  surrounding  the  logical  development  of  the  Command,  Control,  Communications, 
Computers,  Intelligence,  Surveillance,  and  Reconnaissance  (C4ISR)  network  in  a  network-centric  unit.  The  central  medium 
for  this  presentation  will  be  a  summary  of  an  actual  development  process  conducted  for  a  notional  Future  Combat  System 
(FCS)  based  brigade  force  design.  This  work,  the  brigade  force  design,  and  its  corresponding  C4ISR  structure,  is  taken  from 
the  Objective  Force  Survivability  Study,  a  U.S.  Army  Training  and  Doctrine  Command  (TRADOC)  Analysis  Center  (TRAC) 
directed  study.  The  summary  will  define  relevant  terms,  establish  a  common  understanding  of  the  development  method, 
outline  the  steps  taken  to  develop  a  logical  structure,  and  walk  through  examples  of  the  logical  flow  of  information. 
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How  Much  is  Enough  Assessment  of  Data  Requirements  of  U.S.  Army  Units  from  Combat  Training 
Centers  (CTCs)  Data  and  Observations 
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Over  the  last  two  decades  RAND  researchers  have  collected  space  data  on  specific  aspects  of  units  training  at  the  CTC. 
In  1987  Dr.  Martin  Goldsmith  demonstrated  that  both  blue  force  and  opposing  force  battlefield  success  at  the  National 
Training  Center,  (NTC,)  was  dependent  on  the  accuracy  of  the  unit’s  intelligence  preparation  of  the  battlefield.  In  the  1988- 
1990  time  period  Drs.  James  Kahan  and  Robert  Worley  investigated  commanders’  information  requirements  during  the 
warfighter  exercise  at  the  Battle  Command  Training  Program,  (BCTP.)  During  this  time.  Goldsmith  and  Steve  Kirin 
investigated  data  flow  at  the  tactical  artillery  level  at  all  three  tactical  combat  training  centers.  In  1994,  Dr.  Jon  Grossman 
determined  the  impact  of  GPS  data  on  units’  performance  at  the  NTC,  and  developed  a  baseline  database  on  battalion  level 
command  and  control  measures  of  performance.  (MOPs)  In  1995  Dr.  Bryan  Hallmark  conducted  similar  research  at  the 
company  level. 

These  research  efforts  indicated  that  the  Army’s  digitzation  effort  could  significantly  enhance  a  unit’s  performance  on  the 
battlefield.  The  research,  however,  also  indicated  that  many  units  were  at  their  limits  in  their  ability  to  process  battlefield  data 
and  that  digitization  could  potentially  overwhelm  a  unit  with  more  data  than  it  could  handle.  During  the  Army’s  Advance 
Warfighting  Experiments,  (AWEs,)  published  reports  indicated  that  both  effects  were  observed.  The  same  blue  force  unit  was 
able  to  decisively  use  the  digital  data  available  to  win  one  battle  but,  in  the  next  battle,  be  overwhelmed  by  the  massive 
amounts  of  digital  data  and  lose. 

Using  the  results  of  the  RAND  research  and  Army  reports  on  the  AWEs,  an  assessment  of  how  much  data  is  enough  for 
units  to  “win”  at  NTC  will  be  presented.  Data,  by  itself,  does  not  guarantee  victory.  How  a  unit  processes  data  and  uses  the 
resultant  information  was  found  to  be  as  important  as  obtaining  the  data.  Observations  on  how  high  performing  units  at  the 
NTC  and  BCTP  appear  to  process  data  and  use  information  efforts  are  presented.  The  presentation  will  conclude  with  a 
discussion  of  implications  regarding  the  Army’s  digitzation  efforts. 
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The  Joint  Interoperability  Test  Command  (JITC)  is  forging  new  ground  as  the  Operational  Test  Agency  (OTA)  for  the  Global 
Command  and  Control  System  (GCCS).  GCCS  is  an  automated  information  system  designed  to  support  situational  awareness 
and  deliberate  and  crisis  planning  with  the  use  of  an  integrated  set  of  analytic  tools  and  flexible  data  transfer  capabilities. 
GCCS  will  be  the  single  Command,  Control,  Communications,  Computers  and  Intelligence  system  to  support  the  Warfighter 
from  the  foxhole  to  the  command  post. 

The  size  and  complexity  of  GCCS,  coupled  with  the  unique  acquisition  strategy  and  the  dynamic  schedule,  pose 
challenges  for  the  test  community.  JITC  has  developed  a  comprehensive  strategy  for  GCCS  Functional  Qualification  Testing 
(FQT)  and  Operational  Test  and  Evaluation  (OT&E).  This  strategy  is  designed  to  meet  the  unique  challenges  posed  by 
GCCS  and  provide  timely  information  to  the  Warfighter,  Department  of  Defense  (DoD)  Joint  Staff,  Director  Operational  Test 
and  Evaluation  (DOT&E),  Defense  Information  Systems  Agency  (DISA)  and  the  Milestone  Decision  Authority  (MDA). 

As  the  operational  tester  for  GCCS,  JITC  ensures  the  Warfighter's  perspective  is  captured  as  value-added  to  the 
development  process.  During  each  Field  Test  JITC  assesses  the  operational  effectiveness  and  operational  suitability  of  the 
GCCS  version  release  under  test. 

Through  interoperability  certification,  we  ensure  the  Warfighter  can  obtain  information  that  is  accurate,  timely,  and 
useful.  Based  on  the  Warfighter's  requirements  for  information  exchange  and  through  our  efforts  in  evaluating  incremental 
software  releases,  we  help  assimilate  new  and  affordable  technology  more  quickly  into  our  fight  and  win  systems. 
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Command  and  Control  Battlelab  Surveillance  Management  and  Reconnaissance  Tasking  System 
(CSMARTS) 
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(850)  884-8243,  Roxanne.holt@hurlburt.af.mil 

Currently,  no  single  intelligence,  surveillance,  reconnaissance  (ISR)  architecture/system  exists  in  the  Air  Operations 
Center  (AOC)  to  directly  support  management  of  ISR  platforms  and  sensors.  Specifically,  the  ISR  and  time  critical  targeting 
(TCT)  operators  work  with  disparate  stovepipe  systems  that  display  intelligence  information  from  a  variety  of  sensors  and 
message  traffic.  Hence,  today’s  combat  operations  systems  and  infrastructure  provide  inadequate  support  for  efficient  re¬ 
tasking  of  ISR  platforms.  The  Command  and  Control  Battlelab  (C2B)  developed  and  proved  an  ISR  Battle  Management 
(BM)  concept  of  operations  (CONOPS)  and  tactics,  techniques,  and  procedures  (TTP)  which  codified  ISR  processes  and 
procedures  within  the  AOC.  This  effort  utilized  two  existing  tools:  the  Joint  Services  Workstation  (JSWS)  and  the  Integrated 
Collection  Situational  Awareness  System  (ICSAS).  JSWS  is  used  for  battlespace  visualization,  while  ICSAS  is  used  for 
sensor/platform  situational  awareness.  The  C2B’s  CSMARTS  initiative  will  take  these  processes  and  create  an  operating 
environment  and  a  common  viewing  environment  that  includes  the  JSWS  and  ICSAS,  in  addition  to  the  Web-enabled 
Temporal  Analysis  System  (WebTAS).  CSMARTS  will  significantly  enhance  ISR  and  TCT  personnel’s  ability  to  identify, 
exploit,  and  target  potential  threats.  This  in  turn  reduces  execution  time  and  improves  the  kill  chain  through  better  situational 
awareness. 
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For  the  past  several  years,  the  ONR-sponsored  Adaptive  Architectures  for  Command  and  Control  (A2C2)  research  team  has 
examined  the  concept  of  organizational  “congruence.”  This  is  a  contingency  theory  paradigm  that  proposes  that  organizational 
effectiveness  can  be  improved  when  characteristics  like  organizational  structure  are  designed  to  fit  the  requirements  of  the  mission  or 
environment  (e.g.,  Donaldson,  2001;  Van  de  Ven  &  Drazin,  1985).  Similarly,  when  the  structure  is  out  of  “alignment,”  quality  of 
performance  should  be  reduced  and,  if  significant,  this  misalignment  may  drive  organizational  adaptation.  Some  previous  A2C2 
efforts  have  examined  ways  to  measure  “fit”  or  “alignment”  between  structure  and  task  requirements  (e.g.,  Levchuk,  Meirina,  Levchuk, 
Pattipati,  &  Kleinman,  2001).  The  research  to  be  reported  here  focuses  on  an  experimental  effort  to  determine  factors  that  make  tasks 
well  suited  for  one  organizational  structure  and  poorly  suited  for  another.  The  paper  presents  the  most  recent  research  findings  and 
plans  for  future  experimentation  that  further  the  investigation  of  organizational  congruence. 

In  order  to  test  the  congruence  theories  empirically,  our  approach  is  to  seek  two  sufficiently  disparate  organizational  structures  and 
design  two  missions  (or  scenarios)  that  would  exploit  the  differences  in  these  two  structures.  Thus,  the  first  scenario  would  be  “tuned” 
to  organization  1  through  a  high  degree  of  congruence,  and  would  also  be  “mismatched”  (i.e.,  exhibit  low  congruence)  with 
organization  2.  Clearly,  the  reverse  is  necessary  for  the  second  scenario.  Before  directly  embarking  on  such  an  experiment  we  decided 
that  it  would  be  necessary  to  first  conduct  a  Concept  Experiment  to  elucidate  the  characteristics/properties  of  the  mission  (tasks) 
needed  to  meet  our  scenario  design  requirements  for  the  yet-to-be  selected  organizations.  In  short,  given  the  web  of  variables  that 
influence  performance,  the  nature  of  the  contextual  factors  that  might  affect  congruence  is  not  obvious.  Accordingly,  the  focus  of  this 
paper  will  be  on  the  design  and  results  from  a  Concept  Experiment  in  which  we  examined  the  types  of  contextual  factors  that  might  be 
well  suited  for  or  challenge  different  organizational  structures.  Our  goal  is  to  further  our  understanding  of  specific  task  factors  that  can 
be  used  to  determine  the  org  form  that  will  yield  best  performance. 

A  previous  experiment  (Hutchins,  Kleinman,  Hocevar,  Kemple  &  Porter,  2001),  co-sponsored  by  OPNAV-N6C  and  ONR  and 
conducted  at  the  Naval  Postgraduate  School  (NPS)  in  March  2001,  provided  some  important  initial  operationalizations  of 


52 


C4ISR  WG-6 

organizations,  mission  and  tasks  for  the  Concept  Experiment.  In  the  N6C  experiment,  we  examined  the  processes  of  self¬ 
synchronization  among  a  set  of  geographically  dispersed  (Naval)  commanders.  A  primary  independent  variable  in  that  study  was  the 
definition  of  role  responsibility  (C2)  that  each  commander  had:  a)  Functional  -  in  charge  of  a  major  warfare  area  theater- wide,  or  b) 
Divisional  -  in  charge  of  a  single,  multi-function-capable  platform.  The  mission  environment  was  significantly  characterized  by  a 
variety  of  time-critical  tasks  (e.g.,  SCUD  missile  launchers.  Search  and  Rescue). 

The  two  organizational  structures  examined  in  the  N6C  research  were  viewed  as  suitable  candidates  for  the  Concept  Experiment, 
and  many  of  the  tasks  that  constituted  the  overall  mission  were  sufficiently  complex  to  provide  a  situational  context  to  examine 
differences  in  processes  and  performance  for  the  different  structures.  However,  one  major  change  from  the  N6C  experiment  was 
necessary:  In  the  previous  experiment  a  functional  warfare  area  commander  did  not  necessarily  “own"  all  of  the  assets  that  had  major 
capability  in  his/her  assigned  area.  (This  was  a  research  design  constraint  to  give  the  same  asset  ownership  pattern  for  both  functional 
and  divisional  organizations.)  To  achieve  truly  Divisional  and  Functional  organizational  structures,  it  was  necessary  to  give 
commanders  direct  (rather  than  indirect)  control  over  assets  in  both  structural  types.  This  change  was  instituted  in  the  Concept 
Experiment. 

Thus,  the  Concept  Experiment  that  we  conducted  (and  is  reported  in  this  paper)  examined  both  a  functional  and  divisional 
organizational  structure  performing  a  single  mission  that  consisted  of  a  variety  of  complex  tasks.  The  mission  tasks  were  virtually 
unchanged  from  the  N6C  experiment,  but  as  noted  asset  ownership  (who  owns  what)  differed  for  the  two  structures.  The  experiment 
was  conducted  at  NPS  in  October  2001  using  the  same  DDD  (Distributed  Dynamic  Decision-making)  simulator  as  the  N6C 
experiment.  A  total  of  42  student/officer  players  were  assigned  to  seven  six-person  teams.  Each  team  played  in  both  functional  and 
divisional  conditions,  with  order  counterbalanced  across  teams.  There  were  two  primary  purposes  of  this  study:  1)  to  pilot  test  the 
operationalization  of  the  two  organizational  structures  in  DDD,  and  2)  to  gather  data  on  performance  and  processes  on  different  task 
categories  to  identify  the  types  of  contextual  factors  that  determine  organizational  congruence  and  ultimately  influence  organizational 
performance. 

The  data  that  were  collected  included:  a)  DDD/computer  recordings  of  all  decision-maker  actions  (includes  who  attacked  what 
and  when,  who  launched  which  asset  and  when,  etc.);  b)  voice-recorded  communications  data;  c)  decision-makers’  self-reported  data 
on  performance,  teamwork,  workload,  etc.  as  well  as  comparisons  of  the  two  structural  types  on  key  characteristics  (e.g.,  flexibility, 
situational  awareness,  coordination);  d)  SME/observer  data  on  performance  of  key  time-critical  tasks  (SCUD  launchers),  decision¬ 
makers’  teamwork  and  performance;  e)  after-action  reviews  by  the  participants.  As  one  of  the  major  goals  of  this  experiment  was  to 
determine  the  characteristics  of  those  tasks  that  would  be  performed  well  by  structural  type,  but  not  the  other  structural  type  -  and  vice- 
versa  -  our  analysis  examined  differences  by  task  class.  Typical  task  classes  included:  SCUD  missile  launchers,  hostile  aircraft,  hostile 
patrol  boats,  coastal  defense  missile  launchers,  search-and-rescue,  etc.  In  all  there  were  some  25  different  task  classes  (each  with  a 
number  of  instantiations)  that  constituted  the  overall  mission. 

We  analyzed  performance  using  a  number  of  measures  for  selected  task  classes.  Preliminary  data  suggest  that  performance  indeed 
depended  on  task  class.  For  instance,  performance  in  the  functional  architecture  tended  to  be  superior  for  tasks  such  as  SCUD  missile 
launchers  and  the  attack  of  an  air  base,  whereas  performance  in  the  divisional  architecture  tended  to  be  superior  for  tasks  such  as 
interception  of  SCUD  missiles  and  torpedoes  launched  from  hostile  submarines. 

Discussion  in  the  paper  will  focus  on  the  processes  that  lead  to  performance  differences  on  various  task  classes,  and  how  these 
differences  might  be  constrained  by  contextual  effects  related  to  specifics  of  the  scenario  and  structures  explored  in  this  investigation. 
Ultimately,  these  data  will  be  used  to  define  task  characteristics  for  which  certain  structural  types  are  better  suited.  These 
characteristics  will  result  in  recommendations  that  will  outline  the  design  of  the  two  scenarios  that  will  allow  us  to  test  the  congruence 
hypothesis  in  the  next  experiment  to  be  conducted  in  May  2001.  These  scenarios  will  be  designed  so  that,  in  one  scenario  one 
structural  type  should  evidence  “fit"  through  high  performance,  while  the  other  structural  type  should  evidence  “misfit"  or  lack  of 
congruence.  In  the  second  scenario,  a  reversal  of  alignments  should  be  evident.  From  these  data,  we  will  gain  greater  insight  into  how 
misalignment  could  drive  organizational  adaptation.  In  order  to  further  our  work  on  adaptive  organizations,  one  goal  in  this  series  of 
experiments  is  to  identify  key  cues  or  signals  that  indicate  when  misalignment  is  substantial  enough  to  motivate  organizational 
adaptation,  the  teams’  approaches  to  that  adaptation,  and  how  the  cues  and  approaches  vary  depending  on  the  initial  structure. 
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Effects-based  Operations  (EBO)  is  defined  as  a  “process  for  obtaining  a  desired  strategic  outcome,  or  ‘effect’  on  the 
enemy,  through  the  synergistic  and  cumulative  application  of  the  full  range  of  military  and  nonmilitary  capabilities  at  all 
levels  of  conflict.”  (p  lI’  An  effect  is  the  physical,  functional,  or  psychological  outcome,  event,  or  consequence  that 
results  from  specific  military  or  non-military  actions.  The  EBO  concept  is  based  on  the  tenant  that  a  better  understanding 
of  the  adversary  and  the  increased  involvement  of  other  national  agencies  will  lead  to  better-reasoned  options  to  engage 
potential  adversaries. 

Key  aspects  of  EBO  are  the  ability  of  decision  makers  to  quickly  recognize  any  unexpected  effects  and  the  flexibility 
and  agility  to  adapt  to  the  implications  of  those  effects.  This  highly  adaptive  quality  is  anticipated  to  increase  prospects 
for  success  while  reducing  the  potential  for  failure.  A  second  key  aspect  of  EBO  is  an  emphasis  on  the  ability  to  examine 
the  causal  linkages  and  effects  through  which  actions  lead  to  objectives.  Causal  linkages  help  planners  understand  why  a 
proposed  action  could  be  expected  to  produce  a  desired  effect  given  the  current  circumstances.  A  third  aspect  is  the 
broadened  focus  of  the  Joint  Task  Force  (JTF)  Commander  to  producing  effects  against  an  adversary’s  will  and  behavior 
in  addition  to  his  means  and  capabilities.  This  ability  to  more  precisely  select  the  right  set  of  actions  offers  the  Joint  Force 
Commander  the  ability  to  further  minimize  undesired  collateral  effects. 

An  experiment  entitled  Effects  Tasking  Order-to- Actions  Limited  Objective  Experiment  (ETO-to- Actions  LOE),  was 
conducted  at  the  US  Joint  Forces  Command  (JFCOM),  Joint  Experimentation  Center,  Suffolk,  VA,  3-14  December, 
2001,  to  examine  aspects  of  EBO,  and  to  specifically  assess  and  refine  the  effects-based  planning  and  assessment  (EBPA) 
processes.  This  experiment  was  designed  and  conducted  by  a  partnership  of  the  Naval  Postgraduate  School,  JFCOM  J9, 
and  the  Navy  Warfare  Development  Command.  Previous  experiments  and  events  focused  primarily  on  the  Joint  Force 
Headquarters  (JFHQ)  level  of  command,  with  the  majority  of  effort  directed  at  refining  the  process  down  to  producing  an 
ETO  (which  effectively  issues  effects-based  orders  to  the  subordinate  functional  components).  The  ETO-to-Actions  LOE 
focused  within  and  below  the  JFHQ  to  examine  the  required  coordination  and  collaboration  processes  (both  vertically 
and  horizontally)  between  the  JF  and  functional  components  headquarters,  which  is  needed  to  collaboratively  develop  the 
ETO  and  translate  the  effects  directed  in  it  into  tactical  actions  on  the  battlefield. 

The  experimental  participants  included  representatives  from  all  services,  organized  into  a  Joint  Task  Force  HQ  staff 
and  functional  component  HQ  staffs  (air,  maritime,  land,  special  operations  force,  and  political).  Thirty-nine  percent 
were  active  duty  and  forty-two  percent  were  retired  military  personnel.  Three  days  of  training  on  the  new  processes  and 
collaboration  tools  were  provided  to  familiarize  participants  with  the  new  concepts.  Five  days  of  game  execution 
consisted  of  the  collaborative  planning  between  the  Joint  Task  Force  staff  and  the  subordinate  functional  component 
staffs,  culminating  in  the  JTFC  issuing  an  ETO  to  the  Joint  Force. 

Three  surveys  were  administered  during  the  experiment  to  gather  data  on  the  effectiveness  of  (1)  the  collaborative 
tools  and  the  training  provided  to  the  participants  for  this  experiment,  (2)  knowledge  management  and  collaboration  as 
critical  aspects  of  EBO  planning,  and  (3)  the  EBO  planning  and  assessment  process.  This  paper  reports  on  the  results  of 
the  Knowledge  Management  and  Collaboration  Survey,  and  is  a  companion  paper  to  two  other  papers  that  report  on 
results  of  the  other  two  surveys.  Twenty-nine  items  comprised  the  KM  survey.  Participants  were  asked  to  rate  the  extent 
to  which  they  agreed  with  statements  by  using  a  five-point  Lickert  scale  that  ranged  from  “strongly  disagree”  to  “strongly 
agree.”  The  survey  was  administered  to  the  99  experimental  participants;  95  completed  surveys  were  returned. 

Survey  items  related  to  situation  assessment  and  information  management  asked  participants  about  their  level  of 
situation  awareness  within  their  cell  and  across  the  JTF/Component  organization,  their  ability  to  obtain  adequate  and 
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timely  information,  types  of  information  they  were  unable  to  obtain  and  causes  of  problems  in  obtaining  information. 
Other  survey  items  pertained  to  the  effectiveness  of  the  organization  the  effectiveness  of  asynchronous  collaboration 
sessions;  and  the  extent  to  which  they  were  able  to  conduct  collaborative  planning  that  was  closely  coordinated  with 
subordinate  commands.  In  addition,  survey  items  measured  the  effectiveness  of  the  ONA,  ability  to  assess  the  value  of 
engaging  a  specific  adversary  node,  and  the  presentation  aspects  of  information. 

1.  A  Concept  Framework  for  Effects- Based  Operations ,  White  Paper  Version  1.0,  18  October  2001.  US  Joint 
Force  Command,  J9,  Concepts  Department,  Suffolk,  VA. 

2.  Operational  Net  Assessment ,  TTP  for  MC02,  Draft  Version  1 .2,  20  November  2001 .  US  Joint  Force  Command, 

J9,  Concepts  Department,  Suffolk,  VA. 


Model  and  Post-Processing  Integration  and  Evolution  for  FCS  Analysis 
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The  Army  transformation  to  a  full  spectrum  force  will  replace  both  the  light  and  heavy  forces  of  today  and  be  fully 
capable  to  deal  with  all  potential  operations  from  small-scale  contingencies  to  major  theaters  of  war.  The  key  material 
component  of  this  objective  force  is  the  future  combat  system  (FCS). 

The  emergent  evolutionary  network  centric  warfare  concept  and  undefined  FCS-equipped  objective  force  required  the 
Combined  Arms  and  Support  Task  Force  Evaluation  Model  (CASTFOREM)  to  enhance  the  representation  of  information  and 
situational  awareness.  The  modelers  and  analysts  expanded  modeling  and  simulation  (M&S)  capabilities  for  gathering, 
processing,  dissemination,  and  effects  of  technical  design,  organizational,  and  tactical  engagement  information. 

This  paper  will  describe  the  CASTFOREM  model  growth  that  has  taken  place  in  order  to  represent  “a  system  of 
systems”  concept  and  will  detail  evident  shortcomings  and  potential  short  and  long  term  modeling  solutions.  To  handle  the 
volume  of  data  and  number  of  scenarios,  the  TRADOC  Analysis  Center  -  WSMR  created  a  capability  to  quickly  analyze 
model  output,  at  any  resolution  of  interest,  from  individual  entity  examination  up  to  force  level  scrutiny.  The  resulting 
software  is  a  suite  of  post-processing  tools  formally  called  TRADOC  Analysis  Center  Helpful  Engagement  Acquisition 
Toolbox  (TRAC  HEAT),  Unit  Profiles  (TRAC  Pro),  and  network  and  communication  analysis  (TRAC  Net).  Modelers  have 
developed  a  post-processed  output  formats  that  TRAC  suite  can  use. 


Integrated  Communications  Replication  in  CASTFOREM 


David  P.  Kelley 

TRADOC  Analysis  Center 
ATTN:  ATRC-WAB 
WSMR,  NM  88002 
(505)  678-8025;  (505)  678-4314 
kellevd@trac.wsmr.armv.mil 


MAJ  Alvin  F.  Crowder 
TRADOC  Analysis  Center 
Monterey,  CA  93943 
(831)  656-4061,  (831)  636-3086 
crowdera@trac.rps.navv.mil 


Objective  Force  and  FCS  are  expected  to  rely  heavily  on  integrated,  seamless  communications  and  situational  awareness. 
Potential  operating  environments,  including  urban  and  other  complex  terrain,  and  geographical  separation  of  entities  within  an 
operations  area,  both  of  which  may  affect  communications,  are  factors  to  consider  during  the  design  of  equipment, 
organizations,  and  doctrine. 

High-resolution  combat  models  do  not  typically  play  explicit  communications  at  the  entity  level.  Engineering-level 
models  that  could  model  communications  do  not  typically  replicate  the  interactions  during  combat  operations,  including 
attrition,  battle  damage,  and  logistics.  CASTFOREM  currently  has  a  fairly  robust  communications  architecture  portrayal,  but 
it  falls  short  in  its  ability  to  model  the  system  of  systems  communications  constructs  of  the  proposed  Objective  Force. 

This  presentation  discusses  ongoing  studies  in  further  advancing  the  simulation  capabilities  of  CASTFOREM,  developing 
new  descriptive  algorithms  for  embedding  communications  within  a  high-resolution  combat  model,  and  detailing  the 
shortcomings  that  even  a  perfect  replication  might  possess.  The  presentation  will  also  highlight  some  vignettes  used  to  test 
the  application  as  well  as  emerging  results. 
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Effects-Based  Planning  and  Assessment:  Examining  and  Refining  the  Process 


William  G.  Kemple 
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Monterey,  CA  93943 
(831)656-3309 
(831)656-3679  FAX 
kemple@nps.navy.mil 

Dan  Boger 

Naval  Postgraduate  School 
589  Dyer  Road 
Monterey,  CA  93943 
Monterey,  CA  93943 
boger@nps.navy.mil 

The  United  States  Joint  Forces  Command  (USJFCOM)  J9  is  leading  a  transition  toward  a  new  approach  to  warfare.  A 
cornerstone  of  this  new  approach  is  the  concept  of  Rapid  Decisive  Operations  (RDO),  which  integrate  knowledge,  command 
and  control,  and  Effects-based  Operations  (EBO)  to  achieve  the  desired  strategic  outcome  or  “effect”  on  the  enemy  through 
the  synergistic  and  cumulative  application  of  the  full  range  of  military  and  nonmilitary  capabilities  at  all  levels  of  conflict.1 
In  preparing  for  and  conducting  a  RDO,  the  military  acts  in  concert  with  and  leverages  the  other  instruments  of  national 
power  to  understand  and  reduce  the  adversary’s  critical  capabilities  and  coherence.  Focusing  on  effects,  rather  than  attrition, 
enables  a  highly  coordinated  level  of  interservice,  interagency,  and  international  cooperation. 

The  shift  to  EBO  effects  both  planning  and  assessment.  Traditionally,  military  planners  would  focus  on  consideration  of 
factors  such  as  the  number  and  type  of  aircraft  to  be  employed,  types  and  quantity  of  weapons  to  be  used,  and  the  number  of 
sorties  to  be  flown.  Now  the  goal  is  to  emphasize  what  all  these  weapons  and  platforms  will  accomplish,  that  is,  what  overall 
outcomes  will  be  achieved.3  Similarly,  the  effects  assessment  (EA)  process  goes  beyond  traditional  attrition-related  and 
performance-related  assessments  included  in  today’s  combat  assessment  process.  EA  must  be  a  continuous  feedback  process 
that  can  collect,  process,  exploit,  and  disseminate  information  to  the  appropriate  level  (strategic,  operational,  or  tactical)  in 
time  spans  that  allow  commanders  to  make  decisions  in  an  intensely  dynamic  situation.  The  EA  perspective  includes 
“determination  of  whether  some,  or  all  of,  the  desired  effects  were  produced  and,  if  so,  to  what  level,  what  unintended  effects 
were  produced,  their  overall  impact  on  the  joint  effort,  and  how  the  tactical  actions  taken  either  contributed  or  failed  to 
contribute  to  obtaining  the  desired  outcome.”  3  The  experiment  reported  on  in  this  paper  is  part  of  a  sequence  of  experiments 
and  events  planned  to  test  and  refine  new  concepts  being  developed  at  USJFCOM  J9. 

An  experiment  entitled  Effects  Tasking  Order-to- Actions  Limited  Objective  Experiment  (ETO-to- Actions  LOE),  was 
conducted  at  the  USJFCOM,  Joint  Experimentation  Center,  Suffolk,  VA,  3-14  December,  2001,  to  examine  aspects  of  EBO, 
and  to  specifically  assess  and  refine  the  effects-based  planning  and  assessment  (EBPA)  processes.  This  experiment  was 
designed  and  conducted  by  a  partnership  of  the  Naval  Postgraduate  School,  JFCOM  J9,  and  the  Navy  Warfare  Development 
Command.  The  previous  experiments  and  events  focused  primarily  on  the  Joint  Force  Headquarters  (JFHQ)  level  of 
command,  with  the  majority  of  effort  directed  at  refining  the  process  down  to  producing  an  ETO  (which  effectively  issues 
effects-based  orders  to  the  subordinate  functional  components).  The  ETO- to- Actions  LOE  focused  within  and  below  the 
JFHQ  to  examine  the  required  coordination  and  collaboration  processes  (both  vertically  and  horizontally)  between  the  JF  and 
functional  components  HQs,  which  is  needed  to  collaboratively  develop  the  ETO  and  translate  the  effects  directed  in  it  into 
tactical  actions  on  the  battlefield. 

This  paper  will  focus  on  summarizing  data  obtained  from  a  survey  administered  at  the  conclusion  of  this  experiment  to 
obtain  feedback  on  how  well  the  EBPA  process  worked.  Survey  items  asked  respondents  to  rate  their  answers,  using  a  5-point 
Lickert-type  scale  that  ranged  from  "strongly  disagree"  to  "strongly  agree,"  on  questions  that  asked  about  such  topics  as  the 
following:  areas  of  the  effects-based  planning  and  assessment  process  needing  further  refinement,  what  parts  of  the  process 
are  particularly  challenging  (so  that  these  can  be  enhanced  and  more  fully  trained),  what  data /  information/assessments  need 
to  be  provided  to  better  enable  the  process,  how  well  this  process  facilitates  development  of  more  complete/  robust  courses  of 
action,  and  whether  JTF  planners  were  able  to  develop  measures  of  effectiveness  for  the  desired  effects  that  were  meaningful 
and  observable.  Additional  areas  included  in  the  survey  include  items  regarding  whether  use  of  the  Prioritized  Effects  List 
supports  JTF-level  decision  making,  whether  the  right  number  of  people  were  involved  in  the  planning  process,  the  ease  with 
which  participants  were  able  to  stay  informed  when  updates  and  changes  were  made,  the  effectiveness  of  the  components 
participation  in  the  planning  process,  and  several  other  aspects  of  the  effects-based  planning  and  assessment  process. 

1  U  S.  Joint  Forces  Command:  A  Concept  for  Rapid  Decisive  Operations  White  Paper  Version  2.0  Final  Draft.  25  October  2001 . 

2.  Mann,  Edward  C.  Ill  Col  (Ret),  Endersby,  Gary,  Lt  Col  (Ret),  and  Searle,  Tom,  (2001).  Dominant  Effects:  Effects  Based  Thinking  for 
Joint  Operations,  Airpower  Research  Institute,  College  of  Aerospace  Doctrine,  Research,  and  Education,  Air  University. 

3.  U.S.  Joint  Forces  Command,  Joint  Experimentation  Directorate,  Concepts  Department:  Effects-based  Operations  White  Paper  Version 
1.0.  18  October  2001. 
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An  Agent-Based  Modeling  Approach  to  Measuring  the  Value  of  a  Proposed  Information  System 

Major  Robert  H.  Kewlev 
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US  Student  Division 

Fort  Leavenworth,  KS  66027 
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For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of 
battlefield  information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat 
effectiveness  of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to 
gauge  the  extent  to  which  these  systems  increase  combat  effectiveness.  This  paper  describes  a  methodology  we  chose  to 
investigate  whether  an  agent-based-model  (ABM)  could  be  used  to  suggest  appropriate  behaviors  for  a  combat  force  equipped 
with  a  proposed  information  system  such  as  Future  Battle  Command  Brigade  and  Below  -  FBCB2.  The  decision  agents 
within  the  model  will  use  the  information  about  enemy  forces,  friendly  forces,  and  terrain  provided  by  the  proposed 
information  system  to  adjust  the  friendly  course  of  action  to  the  updated  situation.  Our  methodology  is  a  three-step  process. 
We  first  execute  simulation  runs  using  an  existing  dynamic  study  scenario  and  evaluate  the  results  of  these  runs.  In  the 
second  step,  we  transfer  the  terrain,  units,  and  course  of  action  from  the  existing  dynamic  scenario  to  an  ABM  with  intelligent 
agents  that  will  refine  the  course  of  action  genetic  algorithm  by  generating  new  unit  positions  and  routes  based  upon  the 
current  situation.  In  the  final  step,  we  substitute  the  ABM  developed  course  of  action  and  behaviors  back  into  the  dynamic 
study  scenario  and  execute  another  set  of  simulation  runs.  The  performance  of  the  friendly  force  using  the  proposed 
information  system  and  ABM  generated  behaviors  may  be  compared  to  the  performance  of  the  friendly  force  which  failed  to 
take  advantage  of  current  information.  This  gives  insight  into  the  potential  increase  in  combat  effectiveness  realized  through 
the  use  of  an  information  system. 

Measuring  the  Difference  in  Force  Effectiveness  Resulting  From  Changes  in  Information  Systems 

MAJ  Larry  R.  Larimer  Ms.  Kelaine  M.  Nick 

TRADOC  Analysis  Center  TRADOC  Analysis  Center 

ATTN:  ATRC-WBC  ATTN:  ATRC-WBC 

White  Sands  Missile  Range,  NM  88002  White  Sands  Missile  Range,  NM  88002 

(505)  678-2914;  (505)  678-8074  (505)  678-5966;  (505)  678-8074 

larimerlr@trac.wsmr.armv.mil  nickkm@trac.wsmr.army.mil 

For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness  of 
our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  how  well 
proposed  information  systems  perform. 

This  paper  describes  a  methodology  we  chose  to  assess  the  value  of  an  information  system  (Force  XXI  Battle  Command, 
Brigade  and  Below  -  FBCB2)  to  the  battlefield  decision  maker.  Our  approach  focuses  on  use  of  the  CASTFOREM  combat 
model  with  emphasis  on  tying  decisions  and  activities  to  available  information.  We  discuss  use  of  a  detailed  communications 
modeling/information  flow  capability  in  CASTFOREM,  situational  awareness  databases  at  the  platform  level,  decision¬ 
making  logic,  and  the  incorporation  of  enhanced  Combat  Service  Support  modeling  driven  by  communications  and  self- 
determined  movement  routes. 

OODA  Versus  ODOA 

Kemp  Littlefield 

Sonalysts  Inc. 

5101  Cleveland  Street,  suite  301 
Virginia  Beach,  VA  23435 
757  490-3927 

Most  military  planners  and  commanders  are  familiar  with  OODA  (Observe-Orient-Decide-Act)  loops.  The  OODA  loop 
was  the  brainchild  of  the  late  COL  John  R.  Boyd  (USAF  Ret),  who  developed  this  approach  to  warfighting  based  upon  his 
experiences  during  aerial  combat  in  the  Korean  War.  His  loop  has  been  applied  to  all  levels  of  warfare  and  is  based  upon 


57 


C4ISR  WG-6 

operating  inside  of  the  opponent’s  decision  cycle.7  This  OODA  loop  construct  has  stood  the  long  test  of  time,  but  needs  to  be 
updated  for  the  Information  Age.  Currently,  our  decision  cycle  is  mired  in  the  past.  Only  marginal  changes  are  occurring  as 
we  apply  technology  to  the  existing  military  decision  process.1 2 3  We  have  to  transform  this  process  to  fully  leverage  the 
technology  of  today  and  the  future.  It  needs  to  be  adjusted  to  ODOA  (Orient-Decide-  Observe-Act).  With  today’s 
Revolution  in  Military  Affairs  (RMA)  or  Evolution  in  Military  Affairs  (EMA)J,  one  thing  is  certain  -  knowledge  and  speed 
drive  our  operations.  Knowledge  is  the  key  to  battle  space  dominance  and  speed  is  seen  as  the  key  to  exploiting  this 
knowledge.  These  two  qualities  are  the  keystones  of  planning  for  the  future.4  In  the  Information  Age  where  exchanges  occur 
at  the  speed  of  light,  operations  are  more  time  sensitive  than  ever  before.  We  have  to  use  time  to  our  advantage  and  drive  the 
operational  events.  Our  decision  cycle  must  be  such  that  it  drives  the  tempo  of  military  action  and  never  allows  the  opponent 
the  luxury  of  proactive  interaction.  The  opponent  is  overwhelmed  and  is  in  a  constant  reactive  mode.  Initiative  is  ours. 
ODOA  is  a  simple  construct,  which  will  change  the  way  we  do  business  and  leverage  the  attributes  of  knowledge  and  speed  in 
the  Information  Age.  The  purpose  of  this  paper  is  to  examine  Boyd’s  OODA  loop  and  the  ODOA  construct  within  the 
framework  of  the  United  States  Joint  Forces  Command’s  (USJFCOM)  Rapid  Decisive  Operations  (RDO)  concept.  First  we 
will  explore  Boyd’s  OODA  loop  and  describe  the  emergent  RDO  concept  being  explored  by  the  USJFCOM  J9.  Next  we  will 
examine  the  benefits  of  ODOA  with  respect  to  this  emergent  concept  followed  by  its  application  to  warfare  at  the  speed  of 
light.  Although  there  may  be  applications  at  other  levels  of  warfare,  this  paper  will  focus  on  the  operational  level. 

Using  Games  and  Adaptive  Agents  in  C2  Research 

Julia  Louqhran  and  Marcy  Stahl 
ThoughtLink,  Inc. 

703/820-8227  (Marcy  Stahl) 
mstahl  @thoughtlink.com 

This  in-progress  briefing  will  1)  describe  an  approach  to  C2  research  using  adaptive  agents  and  games,  and  2)  discuss 
results  to  date  (which,  as  of  June  2002,  are  anticipated  to  be  available  from  the  adaptive  agent  work  but  not  from  the 
subsequent  human  player  games). 

The  project’s  sponsor  is  the  Joint  C4ISR  Decision  Support  Center  (DSC);  they  are  developing  a  future  Joint  Task  Force 
C2  operational  concept  and  architecture. 

Previous  DSC  work  identified  eleven  key  C2  design  characteristics,  including  preparation  and  training;  shared  awareness; 
and  agility.  These  eleven  characteristics  and  their  related  MOPs  form  a  large  potential  design  space  for  C2  systems  and 
processes.  Determining  how  each  characteristic  affects  C2  and  the  interplay  (either  negative  or  positive)  among  the 
characteristics  is  difficult. 

In  2002,  ThoughtLink  (TLI)  and  the  Center  for  Naval  Analyses  (CNA)  are  conducting  two  inter-related  tasks.  CNA  will 
start  by  developing  an  adaptive  agent  simulation  of  some  of  the  C2  characteristics.  We  will  run  the  simulation  many  times,  to 
intensively  explore  as  much  of  the  design  space  as  possible. 

Based  on  the  interesting  results  from  the  agent-based  simulation,  TLI  will  create  a  game  for  human  players  and  we  will 
conduct  an  experiment  delving  more  deeply  into  these  parameters. 

This  work  builds  on  research  conducted  in  2000  and  2001  for  DARPA  using  an  abstract,  online,  C2  game  called 
SCUDHunt.  TLI  and  CNA  used  SCUDHunt  to  conduct  a  statistically  designed  experiment  and  analyze  its  results.  The 
original  analysis,  as  well  as  a  subsequent  effort  for  the  DSC,  allowed  us  to  explore  the  effects  of  various  factors  on  the  shared 
situational  awareness  and  quality  of  decisions  in  distributed  teams. 

Joint  Air  Operations  Center  (JAOC)  Information  Viewing  Environment  (JIVE) 

LtCol  Stephen  Matechik 

Maj  Ghyslaine  Lockhart 

238  Hartson  St.,  Hurlburt  Field,  FL  32544 

(850)  884-8244 

Ghvslaine.lockhart@hurlburt.af.mil 


1  Gray,  Colin,  Modem  Strategy,  p.  91 . 

2  Littlefield,  Thomas  K.,  Jr,  “The  Military  Decision  Process  -  Overlooked  by  the  Revolution  in  Military  Affairs”,  http://stinet.dtic.mil/cgi- 
bin/fulcrum  main.pl.  Filename:  ADA344635.pdf. 

3  Much  has  been  written  and  expressed  concerning  whether  we  are  in  a  revolution  or  evolution.  I  believe  the  semantics  of  this  are  moot.  The  bottom  line  is 
that  we  are  in  a  period  of  change  and  with  the  great  and  continuing  strides  in  the  digital  world.  The  change  is  moving  a  rapid  rate  with  a  definite 
acceleration.  As  military  professionals  we  can  never  be  comfortable  with  the  status  quo.  As  we  move  up  the  never-ending  staircase  of  advancement  in 
warfare,  one  foot  must  be  reaching  for  the  next  step,  hopefully  ahead  of  the  competition.  If  not  we  would  suffer  the  same  fate  of  the  Stone  Age  societies  that 
met  the  industrial  age  -  Annihilation  and  a  chapter  in  history. 

4  Adams,  Thomas  K.,  “Future  Warfare  and  the  Decline  of  Human  Decisionmaking”,  Paramenters,  VOL.XXXI,  NO.4,  Winter  2001-02,  p.  59. 
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Currently,  no  single  viewing  environment  for  all  data  sources  exists  in  the  Air  Operations  Center  (AOC.)  The  USAF 
Command  and  Control  Battlelab’s  JIVE  initiative  had  four  goals:  access  disparate  data  sources  simultaneously  to  geo- 
spatially  and  temporally  visualize  data  on  one  common  viewing  environment,  improve  the  Joint  Forces  Air  Component 
Commander  (JFACC)  and  his  staff  s  situational  awareness,  rapidly  provide  decision  quality  information,  and  provide  flexible 
viewing  hardware  options.  JIVE  utilizes  and  made  enhancements  to  the  Web-enabled  Temporal  Analysis  System  (WebTAS), 
developed  by  Intelligent  Software  Solutions  (ISS),  to  meet  its  objectives.  JIVE  facilitated  both  access  to  both  static  and 
streaming  data  sources,  enables  the  user  to  filter  data  objects  and  tracks  and  can  project  the  resulting  composite  operational 
picture  as  overlays  on  a  super-high  resolution,  large  field  of  view  datawall  for  improved  AOC  situational  awareness. 
WebTAS  can  also  analyze  accessed  data.  The  JIVE  initiative  reviewed  several  hardware  options  to  include  a  5  X  10ft 
datawall,  appropriate  for  audiences  of  8-12  people,  a  50  inch  flat  plasma  screen  for  audiences  of  5-7  people,  and  a  standard 
monitor  or  laptop.  As  a  result  of  JIVE,  AOC  staff  situational  awareness  and  decision-making  capability  increased. 

Command  Post  of  the  Future:  Functional  Requirements ,  System  Modeling  and  Analysis. 

COL  Mike  McGinnis,  MAJ  Michael  Nowatkowski,  2LT  Cliff  Kyle,  2LT  Nick  Mudd 
United  States  Military  Academy 
Department  of  Systems  Engineering 
West  Point,  NY  10996 

Phone:  (845)  938-2701  Fax:  (845)938-5919 
Email:  mcginnism@usma.edu 

The  past  decade  has  seen  a  shift  in  the  focus  of  our  military  operations  from  a  major  theater  of  war  to  many  types  of 
operations  other  than  war  including  peace  making,  peacekeeping,  and  humanitarian  support,  counter-terrorism  and  cyber 
terrorism.  Current  headquarters  elements  that  command  and  control  such  forces  have,  at  best,  only  made  marginal  changes  in 
organization,  structure  and  equipment  to  adapt  to  new  missions  and  technologies.  This  paper  will  discuss  the  applications  of 
systems  engineering  and  operations  research  to  reengineering  operational-level  command  and  control  systems  around  the  flow 
of  information  to  facilitate  decision-making  and  enhance  military  force  effectiveness.  The  focus  of  our  paper  will  be  on 
defining  functional  requirements,  related  architectures,  and  modeling  and  analysis  of  information  flow  and  information 
operations  within  the  headquarters. 

Automated  Logistics  Information  to  the  Air  Operations  Center  (ALIA) 

Kristina  M.  O'Brien 

238  Hartson  St. 

Hurlburt  Field,  FL  32544 
(850)  884-8258/Fax  884-8232 
Kristina.obrien@hurlburt.af.mil 


Currently,  no  readily  accessible,  decision-quality,  combat  support  (CS)  information  is  available  to  the  Director  of 
Logistics  (A4)  to  support  the  Commander,  Air  Force  Forces  (COMAFFOR)  or  the  Joint  Force  Air  Component  Commander 
(JFACC)  in  the  Air  Operations  Center  (AOC).  Combat  support  data  is  manually  collected  as  required  and  all 
reports/information  are  manually  generated.  Gathering  the  data  is  labor  intensive  and  time-consuming,  and  it  results  in  an 
ineffective  use  of  personnel. 

The  goal  of  the  Automated  Logistics  Information  to  the  AOC  (ALIA)  initiative  was  to  provide  the  JFACC  staff  with 
current,  accurate,  decision-quality  CS  information.  To  accomplish  this,  ALIA  captures  and  compiles  wing-level  CS  data, 
available  in  Theater  Battle  Management  Core  Systems-Unit  Level  (TBMCS-UL),  using  Broadsword  capabilities.  Broadsword 
is  an  Air  Force  Research  Lab  program  that  provides  users  simultaneous  access  to  multiple  and  geographically  separated  data 
sources  through  employment  of  a  secure  web  browser.  Broadsword  automatically  compiles  the  data  retrieved  from  TBMCS- 
UL  systems  throughout  the  area  of  operation  (AOR)  into  CS  decision  quality  web-based  reports  and  stoplight  charts  tailored 
to  meet  the  needs  of  the  AFFOR/A4  and  AOC  staff. 

Weather  Access  for  Visualization  and  Exploitation  (WAVE) 

Capt  Michael  A.  Pratt 

238  Hartson  St. 

Hurlburt  Field,  FL  32544 

(850)  884-8252,  Michael.pratt@hurlburt.af.mil 
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The  Weather  Access  for  Visualization  and  Exploitation  (WAVE)  initiative  will  provide  a  web-enabled  interface  for 
accessing  XML  encapsulated  decision  quality  weather  data  for  warfighter  Command  and  Control  (C2)  and  mission  planning 
applications.  These  applications  currently  rely  on  human  mental  ingestion  and  exploitation  of  pictorial  images  of  weather 
data.  Interpreted  data  must  be  manually  entered  into  the  warfighter  and  C2  applications.  The  C2  Battlelab,  in  partnership 
with  Air  Force  Research  Lab,  and  with  the  support  of  the  Electronic  Systems  Center,  will  develop  an  Application  Program 
Interface  (API)  to  the  Joint  Weather  Impact  System  (JWIS).  Utilizing  state  of  the  art  XML  tags,  WAVE  will  enhance  the 
Environmental  Data  Cube  in  JWIS,  and  build  a  business-to-business  style  API  allowing  warfighter  and  C2  applications  to 
access  decision  quality,  geo-referenced  weather  data.  The  capabilities  of  WAVE  will  be  demonstrated  within  the  USAF  C2 
Battlelab’ s  Master  Air  Attack  Planning  Toolkit  to  access  weather  data  during  Joint  Expeditionary  Forces  experiment  2002 
and  Millennium  Challenge  2002. 

Speech  Interface  for  Data  Exploitation  and  Retrieval 

Capt  Michael  A.  Pratt 

238  Hartson  St. 

Hurlburt  Field,  FL  32544 
(850)  884-8252 
Michael.pratt@hurlburt.af.mil 

The  Speech  Interface  for  Data  Exploitation  and  Retrieval  (SPIDER)  initiative  utilizes  state-of-  the-art  speech  recognition 
technology  to  include  natural  language  understanding  modeling  techniques,  to  enhance  the  Web-enabled  Temporal  Analysis 
System  (WebTAS)  for  use  by  Joint  and  Combined  Air  Operations  Center  (J/CAOC)  personnel.  Spider  will  provide  a  simple 
and  intuitive  voice  interface  for  data  access,  retrieval,  exploitation,  and  visualization  with  the  USAF  Command  and  Control 
Battlelab’s  (C2B)  JAOC  Information  Viewing  Environment  (JIVE)  Datawall  and  Mission  Air  Attack  Plan  (MAAP)  Toolkit 
initiatives.  SPIDER  seeks  to  capitalize  on  lessons  and  benefits  learned  during  the  C2B’s  Joint  Applications  of  Speech 
Technology  (JAST)  initiative,  such  as  increased  data  retrieval  rates,  ease  of  use,  speaker  independence,  reduced  learning 
curves,  and  increased  efficiency  during  Chem-Bio  operations. 

Future  Combat  Systems  (FCS)  Command  and  Control  (C2) 

Gary  Sauer  Don  Timian 

DARPA  Northrop  Grumman  Information  Technoligies 

3701  N.  Fairfax  Dr,  Alexandria,  VA  22203  7900  Sudley  Road,  #  206,  Manassas,  VA  20109 

(703)  696-7493;  (703)  696-9781,  gsauer@darpa.mil  (703)  331-0906;  (703)  361-7642,  dtimian@northropgrumman.com 

As  described  in  the  Training  and  Doctrine  Command’s  (TRADOC’s)  draft  24  January  2001  “The  Objective  Force 
Maneuver  Unit  of  Action”  Operations  and  Organization  Plan,  the  elements  that  describe  combat  power  are  changing.  Today 
combat  power  is  defined  as  a  linear  function:  the  sum  of  maneuver,  firepower,  and  protection  multiplied  by  leadership.  In  the 
Future  Combat  Systems  (FCS)  equipped  force,  combat  power  becomes  an  exponential  equation  where  the  factors  of 
maneuver,  firepower,  protection,  and  leadership  are  raised  by  the  power  of  information. 

This  paper  will  describe  the  joint  Defense  Advanced  Research  Project  Agency  (DARPA)  and  U.S.  Army 
Communication-Electronics  Command  (CECOM)  Research  and  Development  Center  (RDEC)  FCS  C2  program,  as  well  as 
the  overall  experimentation  plan  and  the  FSC  C2  federation. 

Go-To-War-07  A  Look  at  the  effects  of  Digitization  on  a  Major  Theater  of  War 

Major  Karl  Schwartz 

Center  for  Army  Analysis 

6001  Goethals  Road,  Ft.  Belvoir  VA  22060-5230 

703-806-5727,  Schwartz@caa.armv.mil 

As  the  Army  transforms  in  the  21st  Century,  we  have  relied  on  technology  to  achieve  an  edge  in  combat.  Of  specific 
interest  is  the  Command,  Control,  Communications,  Computers,  Intelligence,  Surveillance  and  Reconnaissance  (C4ISR), 
which  is  largely  assisted  by  space-based  platforms  (Global  Positioning  Systems  (GPS)  and  information  dissemination  via 
satellites).  This  focuses  technology  as  a  tool  for  the  commander  to  make  better  decisions  because  of  better/more  information. 
To  this  point,  measurements  have  been  mostly  qualitative  in  nature  (faster,  better,  more).  What  about  quantitative 
measurements?  This  presentation  seeks  to  answer  this  question  as  it  relates  to  a  major  conflict  at  the  theater  level  from  the 
aspect  of  campaign  duration,  losses  of  major  pieces  of  equipment,  and  casualties.  Additional  insights  are  also  presented  about 
the  interactions  between  digital  and  analog  forces  as  digitization  is  phased  into  the  force. 
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Joint  Communications  Network  Analysis  Techniques 

Mr.  Neil  F.  Sleevi,  GS-13 
TRADOC  Analysis  Center  -  Ft.  Leavenworth 
255  Sedgwick  Ave.,  Ft.  Leavenworth,  KS  66027 
(913)  684-9210,  FAX  (913)  684-9191 
sleevin@trac.army 

Appropriate  Joint  communications  network  modeling  is  required  to  ensure  that  proposed  communications  networks  under 
study  are  both  realistic  and  credible.  TRAC-FLVN  has  experience  in  performing  military  network  analysis  for  alternative 
“what-if?”  studies.  These  studies  include  wide  area  network  (WAN)  performance  analysis,  technology  migration,  and 
bandwidth  sizing.  TRAC  has  learned  that  it  is  essential  to  develop  realistic,  plausible  and  operationally  accurate  techniques 
and  modeling  to  ensure  credible  representation  of  the  alternatives.  This  presentation  describes  how  TRAC  has  used  data 
collection  from  SIPRNET,  GCCS  (COP),  GCCS  (13),  and  TBMCS  in  a  Joint  environment,  e.g.  JTF  headquarters  (main  and 
forward)  and  functional  Joint  commands  to  determine  whether  a  network  requires  improvement.  It  shows  how  local  area 
network  (LAN)  probes,  log  files,  “sniffer”  data,  and  wide  area  network  (WAN)  probe  data  is  used  in  a  Joint  communications 
network  study. 

This  presentation  describes  simplified  techniques  for  Joint  communications  modeling  which  accurately  represents 
military  communications  infrastructure  for  the  given  measures  of  performance  (MOP)  and  measures  of  effectiveness  (MOE). 
It  shows  how  mission  critical  data  communications  traffic  flow  is  correctly  modeled.  It  includes  simplified  procedures  to 
ensure  analytical  rigor  and  credibility. 

It  illustrates  techniques  for  Joint  network  analysts  to  use  to  simplify  their  analysis  efforts.  This  presentation  focuses  on 
TRAC’s  use  of  a  stochastic  communications  model  for  the  Joint  community.  It  will  assist  military  analysts  in  conducting 
simplified  communications  network  studies.  A  classified  Enduring  Freedom  case  study  from  CENTCOM  including  playback 
may  be  approved  for  release  and  available  at  the  time  of  presentation. 

Millennium  Challenge  ’02  Data  Instrumentation  Techniques 

Mr.  Neil  F.  Sleevi 

TRADOC  Analysis  Center  -  Ft.  Leavenworth 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 

(913)  684-9210,  FAX  (913)  684-9191 

sleevin@trac.army.mil 

Army  Transformation  Experiment  ’02  (ATEx02)  is  the  Army  Experimentation  Campaign  Plan  (AECP)  event  supporting 
the  US  Joint  Forces  Command  (USJFCOM)  experiment  Millennium  Challenge  2002  (MC02).  MC02  is  a  major  field 
experiment  integrating  Service  and  Special  Operations  Forces  capabilities,  consisting  of  both  live  and  simulated  forces. 
MC02  is  designed  to  demonstrate  the  US  forces  capabilities  to  conduct  Rapid  Decisive  Operations  (RDO)  in  the  2007 
timeframe. 

This  presentation  describes  data  instrumentation  and  collection  requirements  and  analytical  approach  required  for  one 
specific  ATEX02  issue.  The  issue  surrounds  augmentation,  reorganization,  and  additional  capabilities  required  for  an  Army 
corps  headquarters  (HQS)  to  serve  as  a  Joint  Task  Force  (JTF)  HQS.  A  corps  HQS  must  have  a  mission-capable  organization 
with  an  organization  and  supporting  staff  prepared  to  assume  the  role  of  a  JTF  in  a  combined  operational  environment.  JTF’s 
typically  require  augmentation.  For  a  conventional  Corps  staff,  this  is  normally  an  uncomfortable  adjustment.  Traditionally, 
a  Corps  staff  has  relied  upon  another  U.S.  headquarters  (Army)  to  resource,  synchronize  and  provide  guidance,  direction  and 
approval.  The  presentation  describes  novel  techniques  for  data  instrumentation  and  addresses  data  collection  issues  in 
ATEx02  surrounding  experimentation,  observation,  and  analysis.  It  addresses  MC02  jointly  collected  data  and  results 
analysis  that  will  be  required  for  this  important  Army  issue.  It  describes  how  Army  analysts  will  leverage  data  collection  from 
GCCS  (COP),  GCCS  (13),  and  TBMCS  at  all  the  main  and  forward  sites,  e.g.  JTF  headquarters  (main  and  forward)  and 
functional  Joint  commands.  This  effort  will  require  LAN  probes  such  as  SPECTRUM™,  log  files,  “sniffer”  data,  and  wide 
area  network  (WAN)  probes.  The  presentation  also  describes  innovative  techniques  for  obtaining  data  and  “screen  captures” 
from  the  Information  Work  Space™  (IWS)  collaboration  environment  at  each  of  these  Joint  sites  and  afloat  required  during 
MC02. 
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Joint  Data  Support  C41SR  Data  Development 

Mr.  John  Sturm 

Joint  Data  Support 

1225  Jefferson  Davis  Hwy  Ste  200,  Arlington  VA  22202 
703-414-1980,  fax  703-414-8114.  iohn.sturm@osd.pentagon.mil 

The  JDS  office  provides  data  support  and  development  to  a  wide  variety  of  DoD  models  and  studies.  JDS  C4ISR  data 
support  across  the  spectrum  of  JAMIP  models  has  recently  received  emphasis  by  OSD(C3I);  these  models  run  the  gamut  from 
campaign-level  analysis  with  highly  aggregated  C4ISR  representation,  to  more  detailed  system-level  performance  modeling. 
JDS  is  responsible  for  the  preparation  of  authoritative  source  data  into  data  sets  appropriate  for  use  in  these  models.  JDS 
must  identify  the  right  “mix”  of  detail  and  aggregation  that  does  not  compromise  the  utility  of  model  output  in  determining 
C4ISR  impact  on  combat  decision  making  and  combat  outcome.  Additionally,  JDS  is  responsible  for  the  construct  & 
implementation  of  the  underlying  process  &  structure  that  will  not  only  collect  &  store  the  necessary  data,  but  also  implement 
V&V,  transformation,  data  refresh,  and  identification,  development,  and  implementation  of  system  performance  metric 
algorithms.  Topics  covered  are:  JDS  charter;  C4ISR  data  requirements;  data  sourcing  &  population;  data  "ownership"; 
security;  data  storage,  transformation,  &  provisioning;  data  standards;  and  interoperability. 

Future  Combat  Systems  (FCS)  and  the  Joint  Distributed  Engineering  Plant  (JDEP)  (A  Potential 
Venue  for  FCS  Joint  Experimentation ) 

John  W.  Tindall 

MITRE  Corporation 
11493  Sunset  Hill 
Reston  VA.  20190 
(703)883-5389,  FAX  (703)883-1370 
itindall@mitre.org 

The  Army  is  accelerating  the  acquisition  of  FCS  to  meet  the  transformation  goals  of  the  Chief  of  Staff  of  the  Army 
(CS A),  and  DoD.  Concurrently,  OSD  and  other  joint  agencies  are  implementing  JDEP.  JDEP  will  provide  a  distributed  test¬ 
bed  for  Service  developers,  testers,  and  warfighters.  The  time  is  right  for  the  Army  to  try  to  bring  these  two  programs 
together  to  support  joint  warfighting  concept  exploration,  and  Army  acquisition  officials  in  achieving  a  FCS  First  Unit 
Equipped  (FUE)  in  FY2008.  JV2020  promulgates  a  network  centric  warfare  environment  that  can  potentially  provide 

unprecedented  levels  of  situational  awareness  to  the  lowest  tactical  echelons.  FCS  network  centric  concepts  have  to  be 
demonstrated  to  support  acquisition  decisions.  Due  to  the  complexity  of  the  problem,  the  Army  should  develop  small 
“scoping”  experiments  to  evaluate  net-centric  warfare.  This  presentation  will  explore  three  compelling  reasons  why  the  Army 
should  incorporate  a  JDEP  construct  in  the  FCS  Test  and  Evaluation  Master  Plan  (TEMP).  First,  by  employing  JDEP  the 
Army  will  show  commitment  to  FCS  interoperability,  and  a  means  to  assess  network  centric  warfare  development  in  a  joint 
context.  Secondly,  it  will  be  a  method  to  incrementally  test  Command,  Control  and  Communications  On  The  Move 
(C30TM);  thus,  illuminating  some  of  the  sensor  to  shooter  linkages,  responsiveness,  latency,  and  throughput  issues  that  the 
developer  will  have  to  consider  for  FCS.  Finally,  JDEP  could  support  a  compressed  acquisition  timeline  by  integrating  live, 
virtual,  and  constructive  simulations  for  testing  FCS  C4ISR  concepts.  The  presentation  will  conclude  with  a  “way  ahead”  for 
future  FCS  C4ISR  testing  approaches. 


C3  Test  Driver  Scenario  Development 

Mr.  Paul  W.  Works,  Jr 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth  66027-2345 
(913)  684-9160,  Fax  -9191 
worksp  @  trac .  army  .mil 


CPT  Steven  Cram 
TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 

(913)  684-9221,  FAX  (913)  684-9191 

crams@trac.armv.mil 


The  Command,  Control,  and  Communications  Test  Driver  program  was  initiated  in  response  to  a  Deputy  Undersecretary 
of  the  Army  for  Operations  Research  (DUSA-OR)  tasking.  The  US  Army  Test  and  Evaluation  Command  (ATEC),  the  US 
Army  Simulation,  Training  and  Instrumentation  Command  (STRICOM),  and  the  US  Army  Electronic  Proving  Ground  (EPG) 
lead  the  C3  Test  Driver  Program.  The  Program  involves  key  participants  within  the  TRADOC  Analysis  Center  (TRAC),  the 
Central  Technical  Support  Facility  (CTSF),  the  US  Army  Operational  Test  Command  (OTC),  and  the  TRADOC  Threat 
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Support  Directorate  (TSD).  The  objective  is  to  support  developmental,  integration,  and  operational  testing  of  Army  Battle 
Command  System  (ABCS)  components  using  standard  models,  standard  mission/message  threads,  and  standard  scenarios. 

The  scenario  development  effort  was  tasked  in  Phase  I  of  the  C3  Test  Driver  Program  (FY01)  to  produce  an  unclassified, 
brigade-level  scenario  to  be  used  as  the  background  for  C3  Test  Driver  message  generation  and  traffic.  This  scenario  was 
located  on  the  National  Training  Center  and  featured  a  Force  XXI  brigade  against  an  opposing  forces  division.  Key  events 
were  identified  within  a  scripted  time-ordered  event-list  to  initiate  various  mission/message  threads.  C3  Test  Driver  uses  this 
message  traffic  to  stimulate  real  systems  under  test,  evaluate  their  performance,  and  facilitate  developmental  and  integration 
testing. 

Classified  corps-division  and  brigade-level  scenarios  are  being  developed  for  use  in  Phases  II  and  III  of  this  program. 
These  scenarios,  and  vignettes  identified  within  them,  will  use  a  dynamic  simulation  and  a  robust  set  of  doctrinal 
mission/message  threads  to  additionally  support  operational  testing  and  training. 

Getting  at  Enemy  Intent:  Connecting  Perception  to  Command  in  Combat  Modeling 

Dr.  Mark  A.  Younqren 

MITRE, 

McLean,  VA 

(703)  883-6446,  FAX:  (703)  883-1370 
voungren@mitre.org 

The  Joint  Warfare  System  (JWARS)  model  is  the  next  generation  campaign-level  model  for  joint  analysis,  under 
development  by  the  JWARS  program  office.  The  model  is  C4ISR-centric  by  design,  and  has  required  original  research  to 
develop  suitable  algorithms  for  representing  correlation,  association,  and  fusion  at  the  aggregated  level  of  representation 
appropriate  for  a  campaign-level  model. 

Original  research  is  underway  to  support  how  the  model  can  represent  the  perception  of  enemy  intent  at  the  operational 
level.  Previous  research  efforts  (presented  at  previous  MORRS)  have  discussed  the  development  of  correlation,  association, 
and  fusion  models  to  process  sensor  reports  of  detected  enemy  units  into  the  operational  perception.  In  the  past,  most  models 
have  lacked  an  explicit  operational  perception;  those  that  have  modeled  one  are  limited  to  some  form  of  this  unit  oriented  data 
structure. 

An  explicit  perception  is  a  key  to  the  ability  to  model  many  combat  processes.  Until  now,  combat  simulation  models  with 
an  explicit  perception  have  used  this  information  primarily  to  support  short-term  decisions:  targeting  for  strike  and  triggers  for 
(pre)planned  operational  maneuver.  Although  this  represents  a  significant  capability,  it  does  not  permit  proactive  actions  on 
the  part  of  a  commander  -  those  actions  made  not  just  for  immediate  gain,  but  to  block  and  exploit  planned  enemy  actions  and 
command  own  forces  for  long-term  gain.  To  make  these  decisions,  the  commander  must  have  some  perception  of  enemy 
intent.  Modeling  intent  is  also  important  from  the  perspective  of  showing  the  value  of  C4ISR  systems  and  processes  that 
increase  our  ability  to  discern  intent. 

The  paper  that  will  be  presented  in  this  session  will  discuss  the  directions  this  research  has  gone  toward  meeting  the 
modeling  goal.  Previous  research  has  demonstrated  methods  of  modeling  the  fusion  of  multiple  intelligence  sources  to  show 
where  the  enemy  has  been  detected;  just  as  important,  methods  have  been  developed  to  perceive  where  the  enemy  is  absent. 
The  combination  of  these  perceptions,  along  with  IPB,  terrain  analysis,  enemy  doctrine,  and  friendly  operational  concepts, 
gives  us  the  basis  to  develop  some  inferences  about  the  likelihood  of  enemy  actions  -  and  the  command  actions  that  can  be 
derived  from  these  inferences.  This  paper  will  discuss  the  progress  to  date. 

The  research  supporting  this  concept  will  be  submitted,  when  complete,  to  the  government  for  approval  for 
implementation  in  JWARS.  However,  the  basic  research  may  be  usefully  applied  to  all  combat  simulations  that  have  an 
explicit  representation  of  an  operational  perception. 
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The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 

Addressing  the  Cost  and  Value  of  C41  Information  in  AoAs 

Joseph  F.  Auletta 

AFMC/OAG/DR 
3550  Aberdeen  Ave  SE 
Kirtland  AFB,  NM  67117-6778 
(505)646-8214  (V)  (505)646-5518 
Josenh.Auletta@Kirtland.AF.mil 

The  nature  of  major  Air  Force  systems  acquisitions  is  substantially  changing.  The  systems  themselves  are  much  more 
information  dependent,  and  many  of  the  Analyses  of  Alternatives  (AoAs)  for  these  acquisition  systems  must  address  a  trade 
of  money  spent  on  information  vs.  money  spent  on  warhead.  This  presentation  will  focus  upon  several  significant  steps  the 
Air  Force  has  taken  to  improve  how  it  analyses  the  value  of  information  in  AoAs,  some  still-needed  improvements,  and  some 
problem  areas  as  we  continue  to  adapt  the  AoA  process  for  C4I  Systems.  The  specific  areas  of  discussion  include  how  to  cost 
C4I  Support  to  a  weapon  system  and  how  to  measure  the  “value”  of  C4I  in  a  pre-warfare  environment. 

Techniques  for  Intelligence  Analysis  of  Networks 

Jeffrey  R.  Cares 

Alidade  Consulting 
31  Willow  Street 
Newport,  RI 02840 

(401)935-9961  (Phone),  (425)871-5466  (Fax) 
ieff@alidade.net 

Since  September  1 1th,  a  great  deal  of  effort  has  been  expended  on  intelligence  analysis  of  terrorist  networks.  In  general, 
most  of  this  analysis  has  been  conducted  with  the  standard  tools  of  the  intelligence  analyst  —  reports  from  intelligence 
operations  are  collected,  analyzed  and  interpreted.  This  presentation  discusses  an  additional  set  of  tools,  the  techniques  for 
network  mapping  developed  by  Social  Network  research.  Particular  attention  is  provided  to  a  special  class  of  social 
networks,  “covert  networks,”  the  type  found  in  secret  societies,  criminal  organizations  and  underground  groups.  The 
presentation  discusses  how  the  mathematical  techniques  from  Social  Network  research  can  be  applied  to  the  same  data 
available  to  traditional  analysts  yet  lay  bare  important  structures  that  are  not  easily  discerned  by  traditional  methods.  The 
presentation  concludes  with  practical  recommendations  for  competing  against  such  networks. 


Automatic  Target  Cueing  (ATC)  tool  for  Unmanned  Aerial  Vehicle  (UAV)  Synthetic  Aperture  Radar 
(SAR)  products 


Capt.  Arthur  Cartwright,  USAF 


Dr.  Mark  O’Hair 

Unmanned  Aerial  Vehicle  Battlelab 
1003  Nomad  Way,  Ste  107  Eglin  AFB  FL  32542 
Telephone:  850-882-7797 
Fax:  850-882-6942 


Unmanned  Aerial  Vehicle  Battlelab 
1003  Nomad  Way,  Ste  107 
Eglin  AFB  FL  32542 
850-882-7797,  Fax:  850-882-6942 


arthur.cartwright@eglin.af.mil 
Abstract  unavailable  at  printing. 

Counter  Deception  and  Sense-Making  during  Urban  Operations 
Thomas  M  Cook,  Ph.D. 

Army  Research  Laboratory 
ATTN  AMSRL-HR-MY 
Riley  Barracks  (Bldg.  51005) 

Ft.  Huachuca,  AZ  85613-000 
(520)  538-4701,  Fax  (520)  538-0845 
thomas.cook@hua.armv.mil 


64 


WG-7 


OR  and  Intelligence 

The  current  world  situation  begs  us  to  examine  requirements  unique  to  urban  military  operations,  to  include  counter¬ 
terrorism  and  homeland  defense.  We  must  develop  a  better  understanding  of  the  many  complex  factors  (e.g.,  military, 
civilian,  political,  social,  and  physical/environmental)  that  interact  to  influence  military  decisions.  During  urban  operations, 
US  Forces  are  susceptible  to  deception,  particularly  information  deception.  The  quality  of  military  sense-making  and 
decision-making  in  urban  environments  depends,  in  part,  upon  accurate  assessments  of  others'  interests,  intentions,  and 
capabilities,  as  well  as  accurate  assessments  of  the  environment  or  context  within  which  the  action  takes  place.  Forming 
accurate  perceptions  is  a  challenge  even  under  favorable  circumstances  where  clear  and  unambiguous  communication 
between  parties  or  extensive  preparation  and  rehearsal  for  a  particular  turn  of  events  can  occur.  In  complex  urban  settings,  we 
must  be  prepared  for  unfavorable  circumstances  which  might  include  occasions  when  events  are  unfolding  at  a  very  fast  pace, 
or  when  the  background  noise  of  contradictory  opinions  interferes  with  the  accurate  gauging  of  the  intentions  of  others. 
Included  within  these  unfavorable  circumstances  is  a  subset  in  which  one  or  more  participant's  attempts  to  deceive  the  other. 
Clearly,  one  of  these  requirements  is  the  ability  to  make  sense  of  the  intentions,  capabilities,  and  tactics  of  adversaries,  The 
United  States  and  our  allies  must  assume  that  our  adversaries  will  play  to  our  weaknesses,  which  may  include  our  capability 
to  detect,  make  sense  of,  and  counter  deception  operations.  The  focus  of  this  presentation  is  a  framework  for  information  and 
knowledge  to  facilitate  sense-making  and  to  counter  a  sophisticated  capability  for  deception  during  military  operations  in 
urban  environments.  Research  hypotheses  are  suggested  to  further  our  understanding  of  information  and  sense-making 
requirements  in  support  of  urban  military  operations. 

The  Take-Down  of  Kabul:  An  Effective  Coup  De  Main 

Les  Grau 

Foreign  Military  Studies  Office 
Ft.  Leavenworth,  KS 
Les.Grau@leavenworth.army.mil 

Abstract  unavailable  at  printing. 

Command  and  Control  Battlelab  Surveillance  Management  and  Reconnaissance  Tasking  System 

TSqt.  Roxanne  Holt 

Command  and  Control  Battlelab  (C2B) 

238  Hartson  St. 

Hurlburt  Field,  FL  32544-5237 
Roxanne.Holt@Hurlburt.af.mil 

Currently,  no  single  intelligence,  surveillance,  reconnaissance  (ISR)  architecture/system  exists  in  the  Air  Operations 
Center  (AOC)  to  directly  support  management  of  ISR  platforms  and  sensors.  Specifically,  the  ISR  and  time  critical  targeting 
(TCT)  operations  work  with  disparate  stove-piped  systems  that  display  intelligence  information  from  a  variety  of  sensors  and 
message  traffic.  Hence,  today’s  combat  operations  systems  and  infrastructure  provide  inadequate  support  for  efficient  re¬ 
tasking  of  ISR  platforms.  The  Command  and  Control  Battlelab  (C2B)  developed  and  proved  an  ISR  Battle  Management 
(BM)  concept  of  operations  (CONOPS)  and  tactics,  techniques,  and  procedures  (TTP)  which  codified  ISR  processes  and 
procedures  within  the  AOC.  This  effort  utilized  two  existing  tools:  The  Joint  Services  Workstation  (JSWS)  and  the  Integrated 
Collection  Situational  Awareness  System  (ICSAS).  JSWS  is  used  for  battlespace  visualization,  while  ICSAS  is  used  for 
sensor/platform  situational  awareness.  The  C2B’s  CSMARTS  initiatives  will  take  these  processes  ands  create  an  operating 
environment  and  a  common  viewing  environment  that  includes  the  JSWS  and  the  ICSAS,  in  addition  to  the  Web-enabled 
Temporal  Analysis  System  (WebTAS).  CSMARTS  will  significantly  enhance  ISR  and  TCT  personnel’s  ability  to  identify, 
exploit,  and  target  potential  threats.  This  in  turn  reduces  execution  time  and  improves  the  kill  chain  through  better  situational 
awareness. 

Failed  Analysis,  Untapped  Proven  Analytical  Techniques;  A  New  Terrorism  Indications  &  Warning 
Methodology 

Sundri  K.  Khalsa 

Defense  Intelligence  Agency 
Joint  Military  Intelligence  College 
(PGIP  Student,  Box  76) 

Washington  D.C.  20340-5400 
202-231-5642  (phone)  202-231-2171  (fax) 
gurusundri.khalsa@dia.mil 
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This  thesis  proposes,  designs,  evaluates,  and  builds  a  new  terrorism  Indications  and  Warning  (I&W)  methodology  that 
connects  a  master  database  template  with  a  partly-automatic  analytical  process  and  matrix-based  threat  pictures  that  are 
displayed  as  web  pages.  ‘The  best  known  instances  of  intelligence  failures  ...  are  rarely  due  to  inadequate  collection,”  but 
are  more  frequently  due  to  poor  analysis,  and  are  most  often  due  to  policy  makers  ignoring  intelligence.  Policy  makers, 
however,  ignore  intelligence  when  analysis  is  weak;  thus  the  problem  again  points  to  analysis.  Analysis  experts  have 
described  the  benefits  of  numerous  structured  analytical  techniques  and  the  dangers  of  common  warning  pitfalls.  Despite 
these  analytical  insights,  many  intelligence  analysts  do  not  develop  and  utilize  analytical  methods  that  exploit  these  proven 
techniques,  which  can  guard  against  these  recurring  pitfalls.  The  terrorism  I&W  methodology  proposed  here  combines  four 
structured  analytical  techniques  with  the  intuitive  technique  in  a  twelve-step,  partly  automated  process  that  guards  against 
twenty-four  of  the  thirty  common  warning  pitfalls. 

This  thesis  includes  a  disk  containing  a  ready-to-use  template  of  this  methodology  with  its  web  page  interface  and  some 
sample  threat  pictures  produced  from  terrorism,  threat  reporting  on  Saudi  Arabia,  Kuwait,  and  Bahrain  from  August  2000  to 
August  2001.  The  template  on  this  disk  could  be  used  to  establish  a  Counter  Terrorism  Community  I&W  web  site. 

Military  Systemology:  Past ,  Present  and  Future  in  the  Russian  Military 

Jake  Kipp 

Foreign  Military  Studies  Office 
Ft.  Leavenworth,  KS 

This  paper  will  address  the  origins  and  development  of  military  systemology  [voyennaya  sistemolopgiya]  in  the  Soviet 
and  Russian  Armed  Forces  and  its  relationship  to  the  Revolution  in  Military  Affairs  and  the  development  of  military  art. 
According  to  GenMaj  Ryabchuk,  Military  Systemology  is  a  New  Branch  of  Military  Science,  formed  on  the  edges  where 
"Philosophy,  Military  History,  Military  Art,  the  Theory  of  Strategy,  Operational  Art,  Tactics,  Troop  Control,  Operations 
Research,  Systems  Engineering,  General  Systems  Theory,  Cybernetics,  and  Information  Science  Meet."  The  paper  will 
consider  the  post-Gulf  War  debate  among  military  theorists  and  analysts  on  the  utility  of  military  systemology  for  force 
planning,  force  development,  and  military  art.  The  paper  will  focus  on  the  works  of  Captain  1st  Rank  Shevelev  at  the 
Academy  of  the  Academy  of  the  General  Staff  and  General-Major  Ryabchuk. 

Coalition  Interoperability  Trials  in  Joint  Warrior  Interoperability  Demonstration  (JWID)  2002 

Dan  J.  McConnell 

(MITRE  ) 

Defense  Information  Systems  Agency 

5275  Leesburg  Pike,  Falls  Church,  VA  22041 

703.882-1313;  fax:  703.882-2851,  mcconned@ncr.disa.mil 

The  JWID  Program,  administered  by  the  Joint  Staff  (J-6),  a  rotating  Host  CINC  (USPACOM)  and  DISA  (CITI)  was 
established  in  1991  and  has  been  the  predominant  experimental  event  in  the  R&D  community,  eventually  being  competed 
with  Army’s  First  Digitized  Division  (FDD);  the  AF’s  EFX;  and  now  Millennium  Challenge.  JWID02  is  in  transition  from  a 
technology  demonstration  event  with  some  C2  Interoperability  Trials  (C2IT)  being  done  on  the  periphery,  to  C2IT  being 
highlighted  by  key  emerging  infrastructure  technologies  surrounded  by  specific  C2IT  proposed  trials/experiments  targeted 
for  Coalition  and  Combined  operational  environments.  JWID  began  its  C2IT  Program  in  1997  concentrating  predominantly 
on  C2  interoperability  with  GCCS  trials  with  other  Allied  partners’  C2  systems.  In  2001,  C2IT  was  expanded  to  include  four 
principal  technology  interest  areas:  (1)  continuation  of  GCCS-COP  trials;  (2)  collaboration  and  the  first  use  of  the  newly 
designated  standard  for  Defense  wide  collaboration  -  the  Defense  Collaborative  Tool  Suite  (DCTS);  (3)  directory  and 
messaging  services  using  the  Defense  Message  System  (DMS);  and  (4)  Geospatial  Information  and  Imagery  Services  (GIIS) 
-  which  includes  a  comprehensive  program  of  emerging  portal  and  web  services  technologies  called  CINC21,  and  a  specific 
coalition  initiative  coordinated  through  NIMA  named  the  Coalition  Portal  for  Imagery  and  Geospatial  Services  (CPIGS).  As 
a  result  of  the  success  of  this  expanded  C2IT  program  (mainly  US  centric,  but  with  rapidly  increasing  Allied  C2IT  program 
investment),  JWID  is  now  transitioning  to  be  completely  C2IT  focused.  The  transition  brings  JWID  into  a  program  centered 
on  C4ISR  Technologies  Interoperability  for  Combined  and  Coalition  environments. 

Now,  in  JWID02,  C2IT  participation  is  solicited  from  all  defense  industry  and  government  programs  to  complement  a 
comprehensive  range  of  CINC  specified  interest  areas  for  Combined/Coalition  C2IT  technologies  participation.  Language 
Translation  capabilities  is  a  new  interest  area  as  well  as  US  Joint  systems  interoperability  in  preparing  for  future  Coalition 
involvement  with  US  Services  digital  systems.  Technologies  will  be  described  as  to  their  maturity  in  implementation  within 
JWID,  emerging  results  and  lessons  learned,  and  implications  for  evolving  the  JWID  C2IT  program.  Although  a  limited 
assessment  occurs  within  the  JWID  execution,  the  opportunities  for  analysis  and  data  collection  are  significant.  Because  of 
the  scripted  nature  of  the  operational  environment,  technologies  are  introduced  into  an  n  operational  environment  to 
showcase  the  specific  technologies  and  force  the  use  by  selected  warfighters  for  the  explicit  purpose  of  gaining  operation 
feedback/data.  With  added  investment  of  analysis,  these  technologies  could  be  designed  in  numerous  ways  to  focus  on 
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selected  criteria  and  data,  targeted  for  analysis.  This  environment  extends  to  the  most  likely  US  Combined  Operations 
partners  as  well  as  a  Coalition  environment.  The  synergism,  provided  by  separately  resourced  Allied  partners'  own  C2IT 
programs,  offer  a  robust  and  expansive  venue  which  has  yet  to  be  well  exploited.  Opportunities  for  research  and  analysis  are 
available  in  an  environment  that  will  represent  future  Combined/Coalition  operations.  JWID  make  the  operational 
environment  more  conducive  to  extracting  high  fidelity  data  representative  of  future  operations  in  a  Coalition  and/or 
Combined  environment. 

Analyzing  Complex  Threats  for  Operations  and  Readiness  (ACTOR) 

Dr.  Sean  P.  O’Brien 

Center  for  Army  Analysis 

6001  Goethals  Rd.,  Fort  Belvoir,  VA  22060 

Obrien@caa.armv.mil 

Abstract  unavailable  at  printing. 


Indicators  of  CBRN  Activity:  Applying  Pattern  Recognition  Techniques  to  Terrorist  Groups 

Walter  L.  Perry  Thomas  J.  Sullivan 

Senior  Information  Scientist  Information  Scientist 

RAND  RAND 

1200  S.  Hayes  Street,  Arlington,  VA  22201  1200  S.  Hayes  Street,  Arlington,  VA  22201 

(703)  413-1 100  Ext.  5228  (703)  413-1 100  Ext.  5343 

Walter  Perrv@rand.org  Thomas  Sullivan@rand.org 

Data  collected  on  known  terrorist  organizations  allows  agencies  to  build  a  statistical  database  of  characteristics  for  each 
group  to  include  their  level  of  interest  in  the  acquisition  of  chemical,  biological,  radiological  or  nuclear  (CBRN)  weapons. 
These  data  may  be  expressed  on  a  numeric  scale  and  used  to  compute  a  metric  that  measures  the  degree  of  similarity  between 
groups  with  respect  to  these  characteristics.  In  this  paper,  we  suggest  a  heuristic  pattern  recognition  approach  to  classifying 
CBRN  intent  based  on  a  training  set  of  twenty-seven  observations  representing  sixteen  unique  terrorist  organizations.  Our 
suggested  approach  uses  a  vector  of  variable  weights  and  model  parameters  that  minimize  the  resulting  misclassification  rate 
for  the  training  set  and  which  remain  stable  with  respect  to  cross-validation  of  the  data.  An  analysis  of  the  variable  weights 
provides  indicators  of  potential  changes  in  a  terrorist  group's  position  on  CBRN  acquisition. 

Decision  Support  System  for  Coalition  Operations 

Thomas  Reid 

Kapos  Associates,  Suite  400 

591  Camino  De  La  Reina,  San  Diego,  CA  92108 

619-692-0558,  reid@nosc.mil 

Abstract  unavailable  at  printing. 

Global  Threat  Awareness 

CDT  1st  Class  Joseph  Torres 

CDT  1st  Class  Brad  Lowery,  CDT  1st  Class  Nate  Riedel,  CDT  1st  Class  Karl  Hoempler 
PO  Box  4781,  West  Point,  NY  10997 
Phone:  (845)515-3107 

LTC  Michael  Kwinn,  US  Military  Academy,  West  Point,  NY  10997 

Our  project  confronts  the  challenge  of  categorizing  and  simplifying  the  numerous  threats  in  the  world.  We  must  predict 
the  threats  and  potential  mission  types  the  US  Army  will  face  in  the  future  in  order  to  effectively  design  the  Objective  Force. 
This  team  has  approached  this  problem  with  cluster  analysis.  We  plan  to  use  cluster  analysis  to  group  the  threats  in  the  world 
by  similar  mission  types  and  environments.  We  have  designed  a  matrix  that  evaluates  threat  countries,  chosen  by  us,  with  9 
categories.  This  matrix  evaluates  the  countries’  possible  mission  type  and  situation  it  presents  our  military  if  we  were  to 
deploy  there.  Some  of  the  categories  we  use  are  terrain,  government,  military,  and  culture.  Each  country  receives  a  score 
based  off  our  scales  and  runs  through  our  program.  The  program  will  compare  each  country  with  all  the  others’  scores  and 
evaluate  how  close  the  comparison  country  is.  This  will  allow  us  to  group  similar  countries  to  better  prepare  what  types  and 
quantity  of  units  will  be  needed  to  achieve  each  mission. 
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Getting  at  Enemy  Intent:  Connecting  Perception  to  Command  in  Combat  Modeling 

Dr.  Mark  A.  Younqren 

The  MITRE  Corporation 
1820  Dolley  Madison  Blvd. 

McLean,  V A  22101 

(703)  883-6446,  FAX:  (703)  883-1370 

voungren@mitre.org 

The  Joint  Warfare  System  (JWARS)  model  is  the  next  generation  campaign-level  model  for  joint  analysis,  under 
development  by  the  JWARS  program  office.  The  model  is  C4ISR-centric  by  design,  and  has  required  original  research  to 
develop  suitable  algorithms  for  representing  correlation,  association,  and  fusion  at  the  aggregated  level  of  representation 
appropriate  for  a  campaign-level  model.  Original  research  is  underway  to  support  how  the  model  can  represent  the  perception 
of  enemy  intent  at  the  operational  level.  Previous  research  efforts  (presented  at  previous  MORRS)  have  discussed  the 
development  of  correlation,  association,  and  fusion  models  to  process  sensor  reports  of  detected  enemy  units  into  the 
operational  perception.  In  the  past,  most  models  have  lacked  an  explicit  operational  perception;  those  that  have  modeled  one 
are  limited  to  some  form  of  this  unit  oriented  data  structure. 

An  explicit  perception  is  a  key  to  the  ability  to  model  many  combat  processes.  Until  now,  combat  simulation  models 
with  an  explicit  perception  have  used  this  information  primarily  to  support  short-term  decisions:  targeting  for  strike  and 
triggers  for  (pre)planned  operational  maneuver.  Although  this  represents  a  significant  capability,  it  does  not  permit  proactive 
actions  on  the  part  of  a  commander  -  those  actions  made  not  just  for  immediate  gain,  but  to  block  and  exploit  planned  enemy 
actions  and  command  own  forces  for  long-term  gain.  To  make  these  decisions,  the  commander  must  have  some  perception  of 
enemy  intent.  Modeling  intent  is  also  important  from  the  perspective  of  showing  the  value  of  C4ISR  systems  and  processes 
that  increase  our  ability  to  discern  intent.  The  paper  that  will  be  presented  in  this  session  will  discuss  the  directions  this 
research  has  gone  toward  meeting  the  modeling  goal.  Previous  research  has  demonstrated  methods  of  modeling  the  fusion  of 
multiple  intelligence  sources  to  show  where  the  enemy  has  been  detected;  just  as  important,  methods  have  been  developed  to 
perceive  where  the  enemy  is  absent.  The  combination  of  these  perceptions,  along  with  IPB,  terrain  analysis,  enemy  doctrine, 
and  friendly  operational  concepts,  gives  us  the  basis  to  develop  some  inferences  about  the  likelihood  of  enemy  actions  -  and 
the  command  actions  that  can  be  derived  from  these  inferences.  This  paper  will  discuss  the  progress  to  date. 

The  research  supporting  this  concept  will  be  submitted,  when  complete,  to  the  government  for  approval  for 
implementation  in  JWARS.  However,  the  basic  research  may  be  usefully  applied  to  all  combat  simulations  that  have  an 
explicit  representation  of  an  operational  perception. 
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Measures  of  10  Effects  Using  the  Joint  Staff  Analysis  Model 

Dr.  Patrick  D.  Allen 

General  Dynamics  Advanced  Information  Systems 
7025  Harbour  View  Blvd.  Suite  101 
Suffolk,  VA  23435 

(757)  673-2429;  FAX  (757)  673-2390,  pat.allen@gd-ais.com 

The  Joint  Staff  Analysis  Model  (ISAM)  was  developed  for  the  US  Army  Battle  Command  Battle  Lab  to  analyze 
command  post  performance.  JSAM  has  been  selected  as  the  Army’s  J/AWE  tool  to  support  Millennium  Challenge  02.  One 
application  of  JSAM  is  to  develop  measures  of  the  effects  of  information  operations  on  Blue  or  Red  organizations.  Since  the 
model  already  models  the  performance  of  an  organization  without  IO,  including  IO  effects  will  provide  quantitative  measures 
of  IO  on  organizational  performance.  Measures  include  times  to  complete  tasks,  resource  utilization  over  time,  quality  of 
information  products,  effects  on  coordination,  and  other  measures  already  represented  in  JSAM.  We  present  a  proposed 
approach  for  incorporating  a  JSAM-based  IO  analysis  as  part  of  a  limited  objective  experiment  for  Millennium  Challenge  02. 

Network  Interdiction  and  Disruption  Basics 

H.  Ric  Blacksten 

CACI  International,  Inc./JWARS  Office 

1600  Wilson  Blvd,  Suite  1300,  Arlington,  VA  22209 

(703)  696-9490;  FAX  (703)  696-9563,  rblacksten@caci.com 

This  presentation  is  a  basic  tutorial  introducing  and  contrasting  the  problems  of  logistics  network  interdiction  and 
information  network  disruption.  It  introduces  and  contrasts  the  measures  of  effectiveness  for  the  two  classes  of  problem.  It 
explores  the  challenge  of  moving  from  algorithms  for  interdicting  the  planar  networks  common  in  surface  transportation  to 
the  far  more  complex  problems  of  disrupting  or  interdicting  the  non-planar  networks  ubiquitous  in  information  and  air 
transport  networks.  A  dynamic-programming  based  generalized  shortest  route  algorithm  will  be  presented  for  optimally 
interdicting  planar  networks.  Some  simple  algorithms  for  disrupting  small  non-planar  networks  will  be  described. 

Decision  Superiority:  What  It  Is,  Why  It  Is  Important,  and  How  We  Can  Do  It  Better 

Dr.  Peter  Brooks 

Institute  For  Defense  Analyses 

4850  Mark  Center  Dr.,  Alexandria,  VA  22311 

(703-845-2170),  pbrooks@ida.org 


Last  year  the  Institute  for  Defense  Analyses  sponsored  a  Workshop  on  Decision  Superiority.  Fundamental  to  the 
precepts  of  Joint  Vision  2020,  Decision  Superiority  is  defined  as  “better  decisions  arrived  at  and  implemented  faster  than  an 
opponent  can  react... at  a  tempo  that  allows  the  force  to  shape  the  situation  or  react  to  changes  to  accomplish  its  mission.” 
The  purpose  of  the  Workshop  was  to  gain  an  improved  understanding  of  the  enabling  elements  of  Decision  Superiority  and  to 
describe  how  to  organize,  deliver,  and  use  information  to  achieve  this  capability.  The  Workshop  provided  an  opportunity  for 
experts  in  training,  information  technologies,  command  and  control  organizations  and  doctrine,  and  behavioral  science,  as 
well  as  senior  military  personnel,  to  focus  critical  thinking  on  this  important  topic.  Ultimately,  we  plan  to  define  metrics  that 
describe  our  ability  to  achieve  Decision  Superiority.  This  briefing  will  carefully  define  what  is  met  by  decision  superiority 
and  will  discuss  8  recommendations  emanating  from  the  workshop  on  actions  the  U.S.  can  take  to  achieve  it. 
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This  presentation  details  work  in  progress  to  conduct  a  Risk  Assessment  and  Countermeasure  Allocation  Strategy  for  a 
military  information  systems  This  is  a  Joint  Chiefs  of  Staff  J6  directed  effort  that  includes  an  inter-agency  team  with 
members  from  the  National  Security  Agency  (NSA),  Defense  Intelligence  Agency,  and  Defense  Information  Systems 
Agency.  This  effort  is  intended  to  establish  a  methodology  for  conducting  risk  assessments  at  NSA  that  is  repeatable, 
tractable,  and  defendable.  A  baseline  version  of  the  Global  Command  and  Control  System  was  used  to  vet  the  process.  The 
methodologies  used  for  the  assessment  evolved  over  time  and  incorporated  information  assurance  testing,  influence 
networks,  fault  trees,  multi-attribute  utility  analysis,  cost-benefit  analysis,  and  a  budget-constrained  optimization.  The 
presentation  will  also  address  difficulties  and  insights  into  the  development  of  a  mathematical  model  that  satisfies  three 
different  organizations,  accounts  for  positive  countermeasure  effects  on  the  adversary,  includes  negative  effects  that 
countermeasures  impart  on  the  warfighter,  and  includes  both  Peace  and  Wartime  scenarios. 


Modeling  the  Decision  Quality  of  Sensor  to  Shooter  (STS)  Networks 


Dr.  Patrick  J.  Driscoll 

Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10996-1779 
(845)  938-6587;  FAX  (845)  938-5919 
fp5543@exmail.usma.army.mil 


Lt.  Col.  Edward  Pohl 

Department  of  Systems  Engineering 

U.S.  Military  Academy 

West  Point,  NY  10996 

(845)  938-5206;  FAX  (845)  938-5919 

Ed.Pohl  @usma.edu 


At  the  heart  of  all  information  flowing  on  sensor-to-shooter  exists  a  degree  of  uncertainty  that  cannot  be  engineered  out 
of  the  network.  Failing  to  understand  what  these  levels  are,  and  what  they  should  be,  forces  device  designers  to  pursue 
increased  levels  of  precision,  when  in  fact  they  should  be  seeking  increased  accuracy.  At  the  decision  point  in  such 
networks,  the  misperception  that  precision  equals  accuracy  imbeds  a  tacit  vulnerability  in  FCS  design,  which  relies  upon  STS 
networks  to  achieve  heightened  battlespace  awareness.  This  study  presents  a  methodology  that  captures  the  decision  quality 
of  STS  networks  involving  unattended  ground  sensors  (UGS)  and  provides  design  guidance  via  a  novel  stochastic  sensitivity 
analysis. 


Effects-Based  Modernization:  Combat  Air  Forces'  Planning  and  Programming  Analytical  Tool 


Mr.  David  M.  Hickman 

HQ  ACC/DRYS 
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Ms  Lori  Evans 
HQ  ACC/DRYS 
204  Dodd  Blvd,  Suite  226 
Langley  AFB,  VA  23665-2777 
(757)  764-5717;  FAX  (757)764-7217 
lori.evans@langlev.af.mil 


Capt  Kevin  Calhoun 
HQ  ACC/DRYS 
204  Dodd  Blvd,  Suite  226 
Langley  AFB,  VA  23665-2777 
(757)  764-571 7  ;F AX  (757)  764-7217 
kevin.calhoun@langlev.af.mil 


Air  Combat  Command  has  completed  the  development  of  an  analytical  methodology  that  supports  effects-based 
planning  and  programming  for  the  current  Combat  Air  Forces  Program  Objective  Memorandum,  Mission  Area  Plans,  and  the 
Air  Force  Capabilities  Investment  Strategy.  This  briefing  will  illustrate  that  methodology  and  some  useful  techniques  for 
presenting  output. 

The  methodology  evaluates  the  performance  of  today's  Combat  Air  Forces  against  Defense  Planning  Guidance  threats. 
First,  a  series  of  task  hierarchies  are  used  to  evaluate  the  criticality  of  campaign-  and  system-level  capability  shortfalls.  Then 
existing  and  postulated  systems  are  evaluated  for  their  contribution  to  CAF  capability.  Next,  each  system  is  evaluated  to 
determine  which  capabilities  require  improvement  based  on  current  performance.  Material  solutions  are  then  proposed  that 
would  reduce  or  eliminate  a  system  deficiency  currently  contributing  to  a  capability  shortfall.  Finally,  materiel  solutions  are 
scored  against  a  system  capability  hierarchy  whose  attributes  are  system  and  subsystem  performance  parameters  and  whose 
objective  is  to  maximize  system  performance  across  a  spectrum  of  conflict. 
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Developing  an  10  Cell  Structure  for  USEUCOM 

Rick  J.  Holdren 

WPC/AN 
PSC  3  Box  1935 
APO  AE  09021-1975 
011  49  631  536  7995 
Rick.Holdren@wpc.af.mil 

In  August  2001  the  Warrior  Preparation  Center  completed  a  study  for  USEUCOM  identifying  an  Organizational 
Structure  for  EUCOM's  Information  Operations  (IO)  Cell  (J-39).  The  purpose  of  this  study  was  to  capture  lessons  learned 
from  previous  EUCOM  operations  as  they  apply  to  developing  a  theater  IO  Cell  structure.  Given  the  captured  lessons 
learned,  EUCOM  wanted  the  analyst  to  execute  the  following:  determine  an  optimal  EUCOM  IO  Cell  Structure,  identify 
crisis  action  requirements,  and  determine  an  optimal  JTF  IO  cell  structure.  This  presentation  will  discuss  the  methodology 
followed  by  the  WPC  analyst  in  order  to  make  his  recommendation.  ORSA  techniques  used  for  this  study  include 
developing  a  knapsack  optimization  model  using  "What's  Best"  optimization  add-in  for  spreadsheets  and  applying  techniques 
used  in  decision  theory.  This  presentation  will  focus  on  the  ORSA  techniques  used  to  solve  the  problem. 

Space  Situational  Awareness 

D.  Michael  Lyons 

The  MITRE  Corporation 
1 155  Academy  Park  Loop 
Colorado  Springs,  CO  80910-3704 
(719)  550-5617;  FAX  (719)  572-8345 
mlyons@mitre.org 

Abstract  unavailable  at  printing. 


Managing  the  Electromagnetic  Spectrum  within  a  Naval  Battle  Force 


Micheal  Mearns 

NSWCDD/J53 
17320  Dahlgren  Rd. 

Dahlgren,  VA  22448 
(540)653-3467;  FAX  (540)  653-2214 
mearnsdm@nswc.navv.mil 
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(540)  663-0471;  FAX  (540)  663-0171 
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Over  the  past  few  decades,  the  electromagnetic  spectrum  has  overwhelmingly  become  the  medium  of  choice  for 
transmitting  and  receiving  information  within  the  Naval  Battle  Force  as  well  as  communicating  with  elements  outside  the 
battle  force.  In  addition,  the  Navy  uses  the  EM  spectrum  for  surveillance,  fire  control  and  Information  Operations  against 
potentially  hostile  forces.  Despite  this  almost  total  reliance  on  the  EM  spectrum  for  information,  the  Navy  does  not  currently 
have  an  established  process  for  coordinating  use  of  the  spectrum  as  a  whole  within  the  Battle  Force.  Communications  plans 
are  developed  separate  from  radar  plans  and  Information  Operation  plans.  This  lack  of  knowledge  of  the  spectrum  as  a  whole 
has  presented  problems  in  the  past  for  the  U.S.  Navy  and  was  demonstrated  in  the  worst  possible  way  by  the  U.K.  Royal 
Navy  in  the  loss  of  HMS  SHEFFIELD  during  the  Falklands  War.  This  paper  will  discuss  the  current  shortfalls  in  managing 
the  entire  spectrum  piecemeal,  as  well  as  a  proposed  path  toward  integration.  Methods  of  coordinating  spectrum  use  with  the 
Joint  Task  Force  will  also  be  addressed. 


Using  Influence  Networks  for  Information  Operations  Programmatic  Decisions 

Thomas  J.  Reid  Lee  W.  Wagenhals 

L-3  Com  Analytics  Corp  George  Mason  University 

591  Camino  de  la  Reina,  #400  C3I  Center,  MSN  4B5 

San  Diego,  CA  92108  Fairfax,  VA  22030 

(619)  692-0558;  FAX  (619)  692-3161  (703)  993-1712;  FAX  (703)  993-1708 

reid@nosc.mil  lwagenha@gmu.edu 

A  prototype  Decision  Support  System  for  Coalition  Operations  (DSCCO)  was  developed  by  SPAWAR  Systems  Center  - 
San  Diego  to  support  the  Operations  Planning  Team  (OPT)  of  the  Commander  in  Chief,  United  States  Pacific  Command.  The 
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goal  of  DSCCO  was  to  apply  and  integrate  organizational  design  concepts  and  decision  support  technologies  in  planning  and 
executing  multi-national  coalition  operations.  Within  DSSCO,  there  was  a  module  based  on  CAESAR  II  focused  on  the 
analysis  of  alternative  Courses  of  Action  (COAs).  The  capabilities  of  DSSCO  and  the  CAESAR  II  /  COA  module  were 
demonstrated  in  November  2000  at  USCINCPAC. 

A  group  of  subject  matter  expects  collaborated  in  a  distributed  manner  in  developing  the  structure  (the  relationships 
between  causes  and  effects)  and  the  data  of  an  Influence  Net  model  representing  a  key  outcome  in  a  hypothetical  military 
operation  other  than  war  (MOOTW)  in  a  South  Pacific  scenario.  The  Influence  net  was  then  implemented  using  the 
Campaign  Assessment  Tool  (CAT)  developed  at  AFRL/IF  and  modified  to  become  a  module  of  CAESAR  II.  Sensitivity 
analysis  was  used  to  determine  which  actions  could  contribute  substantially  in  achieving  the  desired  effects.  Those  selected 
actions  formed  the  basis  for  the  construction  of  COAs,  namely,  time-phased  sequences  of  these  events.  An  executable  model 
was  derived  and  used  to  simulate  these  COAs  in  the  context  of  the  scenario  and  generate  probability  profiles  (the  probability 
of  achieving  the  targeted  effects  as  functions  of  time). 

The  results  of  these  analyses  were  used  to  inform  the  decision  makers  of  the  probability  range  of  achieving  the  desired 
effects  and  also  to  indicate  the  contribution  of  a  particular  action  to  achieving  the  effect,  i.e.,  how  much  influence  did  a 
particular  action  have  on  the  outcome.  In  a  similar  manner,  CAESAR  can  be  used  to  weigh  the  possible  effects  of  different 
10  programs  on  the  outcomes  of  the  various  illustrative  planning  scenarios  of  the  Defense  Planning  Guidance.  This  can 
provide  richer  data  to  10  programmatic  decisionmakers  upon  which  to  base  those  decisions. 


Multi-Objective  Social  Network  Analysis 

Capt  Rob  Renfro,  PhD 

AFSAA/SAFM 
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Social  networks  depict  the  complex  relationships  of  individuals  and  groups  in  multiple  overlapping  contexts.  Influence 
in  a  social  network  impacts  behavior  and  decision  making  in  every  setting  in  which  individuals  participate.  This  paper 
defines  a  methodology  for  modeling  and  analyzing  this  complex  behavior  using  a  Flow  Model  representation.  Multiple 
objectives  in  an  influencing  effort  targeted  at  a  social  network  are  modeled  using  Goal  Programming.  Value  Focused 
Thinking  is  applied  to  model  influence  and  predict  decisions  based  on  the  reaction  of  the  psychological  state  of  individuals  to 
environmental  stimuli. 


Modeling  Multicommodity  Network  Flow  via  Goal  Programming 
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Goal  programming  is  used  to  model  a  minimum  cost  multicommodity  network  flow  problem  with  multiple  objectives. 
The  network  to  be  analyzed  is  a  single  telecommunication  network  with  multiple  commodities  (e.g.,  voice,  video,  data,  etc.) 
flowing  over  it.  Lagrangian  relaxation  and  Dantzig-Wolfe  decomposition  are  used  to  exploit  the  pure  network  structure  of  a 
minimum  cost  multicommodity  network  flow  problem.  Lagrangian  relaxation  captures  the  essence  of  the  pure  network  flow 
problem  as  a  master  problem  and  sub-problems  (McGinnis  and  Rao,  1977).  Depending  on  the  model  size,  a  goal 
programming  simplex  method  can  also  be  used. 

All  three  modeling  techniques  provide  a  solution  method  to  effectively  analyze  the  multicommodity  network  flow 
problem  at  hand.  Post-optimality  analyses  provide  a  variety  of  options  to  analyze  the  robustness  of  the  optimal  solution.  This 
mix  of  modeling  options  and  analyses  provide  a  powerful  method  to  produce  insight  into  the  modeling  of  a  multicommodity 
network  flow  problem  with  multiple  objectives. 


72 


Information  Operations/Information  Warfare 

Traffic  Analysis  in  the  Cyber  World 


WG-8 


Linda  L.  Weber 

MITRE  Corporation 

7515  Colshire  Drive,  MS:  BOLL 

McLean,  VA  22102 

(202)  231-8622;  FAX  (202)  231-4199 

lweber@mitre.org 

This  paper  reviews  the  art  of  Traffic  Analysis,  a  branch  of  signals  intelligence  analysis  that  deals  with  the  study  of  the 
external  characteristics  of  communications,  and  how  it  can  be  applied  to  the  cyber  world.  Through  example,  it  is  clear  that 
the  methodology  used  in  traffic  analysis  is  applicable  to  reconstructing  and  analyzing  the  networks  used  by  hackers.  This 
paper  also  briefly  touches  on  how  to  get  information  to  support  this  type  of  analysis,  how  to  use  this  information  for  cyber 
applications,  and  highlights  some  areas  needing  change  before  this  methodology  could  be  employed  effectively. 
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This  presentation  describes  preliminary  results  from  a  FY  2002  project  funded  by  the  Threat  Systems  Integration 
Working  Group.  We  explain  the  design  and  analysis  of  a  series  of  experiments  conducted  in  the  Air  Force  Electronic 
Warfare  Evaluation  Simulator  facility.  These  experiments  were  designed  to  identify  important  and  unimportant  hardware-in- 
the-loop  modeling  considerations.  The  specific  application  is  operationally  testing  electronic  countermeasure  systems  that 
attack  modern  surface-to-air  missile  systems  using  seeker-aided  ground  guidance  schemes.  These  missile  systems  use  a 
hybrid  guidance  that  combines  target  tracking  radar  and  semi-active  seeker  inputs  within  the  tracking  loop.  The  tracking 
loop  is  closed  on  the  ground  and  guidance  commands  are  sent  to  the  missile.  Because  both  sources  can  be  used  in  a  guidance 
solution,  the  effect  of  a  countermeasure  is  difficult  to  observe  without  actually  shooting  a  missile.  Some  alternatives  to  live 
shots  include  ground-mounted  seeker  tests  or  tests  using  a  seeker  flown  on  a  test  bed  aircraft.  But,  aside  from  other 
difficulties,  these  solutions  significantly  limit  the  ability  to  fly  operationally  realistic  test  scenarios.  An  option  that  does  not 
restrict  open-air  range  scenarios,  and  the  one  considered  here,  is  to  fly  against  a  target  tracking  radar  in  a  live  simulation, 
record  the  results,  and  then  use  those  results  in  a  virtual  hardware-in-the-loop  simulation  that  adds  a  missile  seeker.  The 
experimental  strategy  starts  with  an  initial  screening  experiment  to  sift  through  a  set  of  candidate  factors  and  identify  those 
that  could  have  significant  impacts  on  selected  responses.  Follow-on  experiments  resolve  confounding,  estimate  the  nature 
of  important  main  effects,  and  identify  important  interactions.  The  goal  is  to  produce  a  set  of  guidelines  for  operational 
testers  to  use  when  planning,  conducting,  and  evaluating  combined  tests. 


Using  Resampling  for  Design  of  Experiments  With  Missing  Data 


Gregory  T.  Hutto,  Technical  Advisor 
53d  Wing 

203  West  D  Avenue,  Suite  406 
Eglin  AFB,  FL  32542-6867 
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Mary  Vaughn,  Associate  Principle  Engineer 
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Building  260  PO  Box  1935 

Eglin  AFB,  FL  32542-1935 

(850)  678-2001,  Fax:  (850)  729-6377 

Marv.Vaughn@eglin.af.mil 


The  usual  approach  to  missing  data  in  factorial  experiments  is  to  estimate  the  level  of  the  missing  treatment  by  fitting  a 
model  to  the  existing  data  and  using  this  calculated  value  as  a  surrogate.  Here,  we  show  an  alternative  using  resampling.  We 
compare  the  two  approaches  and  discuss  the  differences. 
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Resampling  Statistics  and  Designed  Experiments 
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For  those  of  us  that  teach  statistics,  one  result  is  clear:  most  people  find  the  subject  difficult  and  confusing,  leading  to 
either  failing  to  apply  the  correct  methods  in  real  world  problems  or  failing  to  apply  statistics  at  all.  Dr.  Julian  Simon,  a 
founding  father  in  the  field  of  Resampling  Statistics  (1967),  believes  that  the  inherent  difficulty  in  statistics  lies  in  the 
difficulty  of  the  concepts  addressed. 


Dr.  Bradley  Efron,  of  Stanford  University,  independently  developed  a  general  resampling  method  he  called  the 
"bootstrap",  in  the  1970s.  The  basic  idea  is  that  all  the  information  we  have  about  a  sample  is  contained  in  that  sample;  we 
have  no  a  priori  knowledge  that  the  sample  came  from  a  specific  type  of  distribution.  Since  that’s  true,  let’s  treat  the  sample 
as  the  proxy  universe  that  all  samples  come  from.  Everything  else  in  bootstrap  follows  from  that  simple  idea.  Jerome  H. 
Friedman,  a  Stanford  resampling  statistician  said:  "Eventually,  it  will  take  over  the  field,  I  think.'"  (New  York  Times,  Nov. 
8,  1988,  Cl,  C6). 


We  are  in  the  process  of  determining  whether  Dr.  Friedman  is  correct.  Design  of  Experiments  has  revolutionized  testing 
at  the  53rd  Wing,  Eglin  AFB,  but  we  continue  to  struggle  with  generating  enough  practitioners  of  the  method  to  address  all 
the  tests  undertaken  by  the  Wing.  The  chief  difficulty  lies  in  teaching  the  foundations,  mechanics  and  extensions  of  the 
Analysis  of  Variance  (ANOVA)  to  analyze  the  sample  (now  2-3  weeks).  This  paper  represents  a  status  report  on  a  work  in 
progress  -  determining  how  the  attractive  aspects  of  resampling  statistics  can  be  applied  to  the  multivariate  problems  of 
experimental  design.  We  will  summarize  the  background  of  resampling  statistics,  and  the  classical  and  resampling 
approaches  to  analyzing  multivariate  data. 


Herding  Cats — Leading  an  Operations  Analyst  Reinvention  Effort  in  a  Dynamic  Electronic  Warfare 
Group 

Capt  August  G.  Roesener 

36th  Electronic  Warfare  Squadron 
203  West  D  Avenue,  Suite  406 
Eglin  AFB,  FL  32542-6867 
(850)  882-5513,  Fax:  (850)  882-5675 
August.Roesener@eglin.af.mil 

As  Ralph  Waldo  Emerson  noted,  "Fear  always  springs  from  ignorance.”  Change  is  generally  a  feared  and  fought  aspect 
of  operations  in  an  office  or  unit,  especially  when  the  changes  are  instituted  by  superiors  and  forced  downward  to  the  lower 
levels.  If  the  workers  do  not  understand  the  need  or  purpose  for  the  change,  it  will  probably  never  be  fully  adopted  at  the 
lower  levels.  Without  adopting  the  changes,  an  office  or  unit  cannot  incorporate  new  ideas,  methodologies  and  processes  that 
could  increase  efficiency  and  productivity. 

This  presentation  documents  and  discusses  some  of  the  these  issues  in  aspects  of  the  53rd  Electronic  Warfare  Group 
(EWG),  as  it  adopts  and  incorporates  a  different  (not  new)  approach  for  conducting  Test  and  Evaluation  in  a  constantly 
changing  environment.  The  leadership  of  the  53  EWG  enthusiastically  adopted  this  methodology,  called  Experimental 
Design;  however,  its  incorporation  as  a  standard  testing  methodology  was  not  openly  accepted  at  the  lower  levels.  As  a 
result,  many  man-hours  were  expended  educating  members  of  the  lower  levels  in  this  new  methodology.  This  presentation 
will  deal  with  many  aspects  of  incorporating  a  large  change  in  a  dynamic  unit,  including  the  perils  and  pleasures  of 
reinventing  test  processes  from  traditional  methods,  clarifying  the  vision,  focusing  the  efforts,  squelching  rumors,  ensuring 
accurate  communication,  organizational  inertia  and  promoting  acceptance  at  all  levels. 
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Using  Resampling  and  Bootstrap  for  Teaching  Statistics 
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We'll  discuss  how  and  why  we  incorporate  resampling  and  bootstrap  techniques  into  the  36  Electronic  Warfare’s  training 
program  for  operational  analysts.  Statistics,  both  in  practice  and  teaching,  traditionally  has  relied  on  assumptions  of  normality 
or  other  underlying  distributions,  as  a  way  of  easing  computational  burdens.  This  made  sense  when  calculation  was  indeed  a 
burden,  but  with  the  advent  of  substantial  computing  power,  this  is  no  longer  the  case.  Further,  while  distributional 
assumptions  eased  calculation,  they  increased  the  conceptual  burden  on  the  student  and  researcher  alike.  One  result  has  been 
that  statistical  testing  has  become  complex  enough  that  no  one  but  seasoned  professionals  can  be  counted  on  to  consistently 
choose  the  right  test  for  a  given  situation.  Resampling  and  bootstrap  -  nonparametric  approaches  -  are  key  to  trading 
conceptual  burden  for  computational  burden,  making  statistics  far  more  intuitive. 


Sample  Size  Estimation  Using  Bootstrap 


Mary  Vaughn,  Associate  Principle  Engineer 
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One  typically  needs  an  estimate  of  how  many  samples  should  be  collected,  even  before  a  test  starts.  Sample  size 
calculations  for  factorial  tests  typically  make  distribution  assumptions  that  may  not  be  warranted.  We  will  approach  sample 
size  calculation  using  bootstrap,  a  distribution-free  technique,  and  compare  it  to  more  common  approaches. 


Resampling  Statistics  and  Designed  Experiments 

2Lt  Elwood.T.  Waddell 

Operations  Analyst 

36th  Electronic  Warfare  Squadron 

203  West  D  Avenue,  Suite  406 

Eglin  AFB,  FL  32542-6867 

(850)  882-5513,  Fax:  (850)  882-5675 

elwood.waddell@eglin.af.mil 

Frequently,  data  from  factorial  experiments  violate  ANOVA  assumptions.  In  such  situations,  one  can  still  obtain 
confidence  intervals  and  significance  levels  if  nonparametric  methods  are  used  instead.  We  will  show  several  examples  of 
the  use  of  resampling  techniques  to  replace  ANOVA.  Such  an  approach  is  conceptually  simpler  than  ANOVA  and  easy  to 
implement,  yet  it  is  very  close  to  Fisher's  original  construct  for  analysis  of  multifactor  data. 
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2LT  Charles  Woodruff 
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A  team  of  West  Point  cadets  investigated  the  feasibility  and  utility  of  an  unmanned  tactical  reconnaissance  vehicle  with 
both  flying  and  ground  movement  capabilities.  This  was  done  in  response  to  a  set  of  candidate  system  requirements  from  the 
Advanced  Systems  Directorate  at  Redstone  Arsenal,  with  a  target  system  deployment  date  of  2020.  The  team  researched  the 
underlying  technologies  and  their  likely  future  directions  and  looked  at  the  ways  such  a  system  could  be  used,  comparing  it  to 
single-purpose  UAV  and  UGV  systems.  The  analysis  identified  the  most  promising  system  concepts  and  concludes  by 
recommending  directions  for  future  development. 

Design  Principles  of  Unmanned,  Distributed  Combat  Forces 

Jeffrey  R.  Cares 

President,  Alidade  Consulting 

31  Willow  Street 

Newport,  RI  02840 

(401)  935-9961  (fax  (425)  871-5466) 

ieff@alidade.net 

Defense  community  innovators  have  proposed  concepts  that  use  cutting-edge  technologies  to  solve  long  standing 
military  challenges,  including  destruction  of  time-critical  targets,  theater-wide  surveillance  and  power  projection  and  access 
to  contested  littorals.  These  concepts  assume  great  benefit  from  networking  of  unmanned,  distributed  force,  but  a  useful 
definition  of  networked  forces  does  not  yet  exist  and  the  advantages  of  networking  have  not  been  fully  and  convincingly 
expressed.  This  document  defines  and  describes  how  "Distributed  Forces"  provide  Information  Age  advantage  and  offers 
some  force-wide  design  principles  for  future  unmanned  distributed  forces. 
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Automatic  Target  Cueing  (ATC)  tool  for  UAVs  Synthetic  Aperture  Radar  (SAR) 
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Abstract  unavailable  at  printing. 

U.S.  Japan  Bilateral  Study  -  Notional  Sensor  Platform 

Evan  H.  Esaki 

USCINCPAC/J081 

Camp  H.M.  Smith,  HI  96861-4028 

(808)  477-6390  x  2699  (fax  (808)  477-0245) 

eesaki@vic-info.org 

USCINCPAC  is  involved  in  continuing  analysis  with  allies  in  the  Pacific  region.  Last  year,  USCINCPAC  and  the 
Japanese  Joint  Staff  Office  (JSO)  initiated  a  new  bilateral  study.  The  study  is  a  bilateral  joint  assessment  of  the  benefits 
provided  by  a  high  altitude  long  endurance  unmanned  platform  referred  to  as  a  Notional  Sensor  Platform  (NSP)  in 
conducting  maritime  surveillance  of  the  Sea  of  Japan  and  its  littorals  to  monitor  ship  traffic  and  support  humanitarian 
assistance  in  natural  disasters.  This  is  the  first  analytic  effort  involving  USCINCPAC  and  Defense  Agency,  Japan  (JDA) 
since  the  Bilateral  Sea  Lines  of  Communications  Study  was  completed  n  1987.  The  procedures  developed  during  this  study 
will  provide  the  basis  for  future  bilateral  analyses. 

NSP  provides  a  pseudo-satellite  capability  owned  at  the  operational  level.  This  provides  a  flexible  sensor  capability  that 
can  be  tasked  to  respond  to  other  requirements  such  as  natural  disasters.  The  Extended  Air  Defense  Simulation  (EADSIM)  is 
the  primary  model  for  this  analysis.  Detailed  command,  control  and  communication  of  the  NSP  were  modeled  in  EADSIM  to 
model  the  collection,  processing  and  dissemination  of  imagery  data.  Two  different  command  and  control  structures  were 
modeled  as  well  to  measure  the  impact  of  Japanese  Maritime  Self  Defense  Force  (JMSDF)  C2  structure  compared  to  a  Joint 
C2  structure. 

NSP  may  contribute  greatly  to  collection  of  intelligence  data  for  the  Sea  of  Japan  and  its  littorals.  However,  NSP’s 
demands  on  the  regional  Intelligence,  Surveillance,  and  Reconnaissance  (ISR)  infrastructure  may  be  too  high  for  practical 
use.  This  study  will  provide  a  preliminary  assessment  of  NSP  use,  and  may  lead  to  more  detailed  analyses  if  relationships 
between  NSP  benefits  and  demands  are  favorable.  USINCPAC  and  JSO  have  coordinated  a  plan  to  develop  the  database, 
scenario,  and  objectives;  execute  model  runs;  and  analyze  output  data. 

This  briefing  will  provide  a  brief  description  of  the  study  objective,  scope,  approach,  methodology,  database  and 
emergingn  results  of  this  effort.  This  briefing  describes  two  potential  scenarios  for  the  use  of  an  NSP:  maritime  surveillance, 
and  humanitarian  assistance  in  a  disaster.  It  concludes  with  estimates  of  NSP  benefit/demand  relationships. 


A  Simulation  Study  to  Quantify  Targeting  Latencies 
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There  are  two  basic  ways  to  control  an  Unmanned  Combat  Air  Vehicle  (UCAV)  as  it  searches  for  targets,  allow  the 
UCAV  to  act  autonomously  or  employ  man-in-the-loop  control.  There  are  also  two  target  sets  of  interest:  fixed  or  mobile 
targets.  This  research  focuses  on  UCAV-based  targeting  of  mobile  targets  using  man-in-the-loop  control.  In  particular,  the 
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interest  is  in  how  levels  of  satellite  latency  or  signal  degradation  affect  the  ability  to  accurately  track,  target,  and  attack 
mobile  targets.  This  research  establishes  a  weapon  effectiveness  model  assessing  targeting  inaccuracies  a  function  of  latency 
and/or  signal  degradation.  The  research  involved  three  phases. 

The  first  phase  in  the  research  was  to  identify  the  levels  of  latency  associated  with  satellite  communications.  A  literature 
review,  supplemented  by  interviews  with  UAV  operators,  provided  insight  into  the  expected  range  latency  values. 

The  second  phase  of  the  research  identified  those  factors  whose  value,  in  the  presence  of  satellite  signal  latency,  could 
influence  targeting  errors  during  UCAV  employment. 

The  final  phase  involved  developing  and  testing  a  weapon  effectiveness  model  explicitly  modeling  satellite  signal 
latency  in  UCAV  targeting  against  mobile  targets.  This  phase  included  an  effectiveness  analysis  study. 

This  presentation  includes  background  material  on  the  latency  issue  with  UCAV-based  targeting,  an  overview  of  the 
effectiveness  model  and  a  presentation  and  discussion  of  results  obtained  using  the  effectiveness  model. 

Networked  Unattended  Ground  Sensor  Fields  -  Tradeoff  Study  and  Configuration  Rules 

CPT  Linda  Lamm  Patrick  Driscoll,  PhD 

DSE,  Mahan  Hall  D/SE,  Mahan  Hall 

West  Point,  NY  10996  West  Point,  NY  10996 

845-938-5663  (fax  845-938-5665)  845-938-4764  (fax  845-938-5665) 

fll771@usma.edu  fp5543@usma.edu 

We  present  a  methodology  capable  of  illuminating  key  underlying  relationships  that  exist  within  networks  of  unattended 
ground  sensor  (UGS)  fields  in  order  to  quantify  generalized  network  configuration  rules  and  perform  tradeoff  studies  in 
support  of  the  Army  Research  Laboratory  (ARL)  -  Sensors  and  Electron  Devices  Directorate.  Our  effort  in  this  vein  focuses 
on  producing  insights  that  will  facilitate  accurate  combat  simulation  modeling  of  a  variety  of  UGS  fields  (magnetic,  acoustic, 
seismic,  and  IR  image),  thereby  enabling  ARL  to  prescribe  both  the  ideal  number  and  mix  of  sensors  to  employ  within  the 
Future  Combat  Systems  (FCS)  operational  context. 

Moving  Target  Indicator  (MTI)  Applications  for  UAVs 

Anthony  B.  Muccio,  Senior  Engineer 
USAF  UAV  Battlelab 
1003  Nomad  Way 
Eglin  AFB,  FL  32542 
850-882-7839  (fax  (850)  882-6942) 

Anthony.Muccio@eglin.af.mil 

Abstract  unavailable  at  printing . 

Shaping  Future  Naval  Warfare  with  Unmanned  Systems 

Rafael  R.  Rodriquez  Delbert  C.  Summey 

Coastal  Systems  Station  Coastal  Systems  Station 

Panama  City,  FL  32407  Panama  City,  FL  32407 

(850)  234-4666  (fax  (850)  230-7016)  (850)  234-4472  (fax  (850)  234-4133) 

rodriguezrr@ncsc.navv.mil  summevdc@ncsc.navv.mil 

NAVSEA  Panama  City  unveiled  a  comprehensive  vision  for  unmanned  systems  that  will  shape  the  future  of  Navy  and 
DOD  forces  and  augment  force  capabilities.  This  vision,  described  in  CSS/TR-01/09,  focuses  on  issues  of  affordability, 
logistics,  and  automation;  these  issues  are  key  to  broad  scale  acceptance  and  use  of  unmanned  systems.  Affordability  is  a 
achieved  through  the  implementation  of  "smart”  standards  and  modularity  across  a  family  of  unmanned  system  platform 
types  (air,  surface,  ground,  and  underwater).  Multiple  use  mission  packages  on  a  limited  number  (for  example  3  standard 
sizes)  of  unmanned  system  platforms  will  take  advantage  of  economy  of  scale  and  lower  overall  costs.  Logistically,  the 
global  shipping  infrastructure,  not  just  combatants,  will  insert  the  unmanned  systems  into  theater  operations  in  large  numbers. 
This  paper  explores  operations  research  challenges  and  questions  that  must  be  addressed  to  explore  the  envisioned  broad  use 
of  large  numbers  of  unmanned  systems  in  four  relevant  Naval  concepts  of  operation  scenarios. 


Helmut  H.  Portmann 

Coastal  Systems  Station 

Panama  City,  FL  32407 

(850)  234-4056  (fax  (850)  230-7016) 

portmannhh@ncsc.navy.mil 
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Global  Hawk  UAVy  Development  and  Flight  Testing  Programs 


Mai  Jeff  Tkach 

Team  Lead-Global  Hawk  Strategy  and  Plans,  USAF 
2640  Loop  Road  West 
Wright  Patterson  AFB,  OH  45433-7106 
(937)  904-7143  (fax  (937)  656-4054) 

Jefferv.Tkach@wpafb.af.mil 

The  Global  Hawk  Unmanned  Aerial  Vehicle  (UAV)  will  provide  battlefield  commanders  near-real-time,  high-resolution, 
reconnaissance  imagery.  Flying  at  extremely  high  altitudes,  Global  Hawk  can  survey  large  geographic  areas  with  pinpoint 
accuracy,  to  give  military  decision-makers  the  most  current  information  about  enemy  resources  and  personnel. 

Global  Hawk  has  a  wingspan  of  1 16  feet  and  is  44  feet  long.  It  can  range  as  far  as  12,000  nautical  miles,  at  altitudes  up 
to  65,000  feet.  Its  cloud-penetrating,  Synthetic  Aperture  Radar/Ground  Moving  Target  Indicator,  Electro-Optical  and  Infrared 
sensors  can  image  an  area  the  size  of  Illinois  (40,000  nautical  square  miles)  in  just  24  hours.  Through  satellite  and  ground 
systems,  the  imagery  can  be  relayed  in  near-real-time  to  battlefield  commanders. 

Global  Hawk  began  as  an  Advanced  Concept  Technology  Demonstration  (ACTD)  in  1995.  An  ACTD  provides  war¬ 
fighters  a  rapidly-developed  prototype  that  can  be  used  for  Military  Utility  Assessment  (MUA)  and  early  operational 
activities.  In  March  2001,  Global  Hawk  entered  the  Engineering,  Manufacturing  and  Development  phase  of  defense 
acquisition.  Global  Hawk  currently  is  undergoing  flight-testing  at  the  Air  Force  Flight  Test  Center  (AFFTC)  at  Edwards  Air 
Force  Base,  Calif.,  with  over  1200  hours  flown  during  more  than  100  successful  sorties. 

Simulation-based  Technology  and  Investment  Planning  Experiment  (STIPE)  Campaign  Modeling  as 
Applied  on  the  SensorCraft  Technology  Assessment 


James  Zeh 

AFRL/VACD 
2241  Avionics  Circle 
WPAFB,  OH  45433 
(937)  904-6571  (fax  (937)  656-4339) 
iames.zeh@wpafb.af.mil 

Chris  Linhardt 
Veridian  Engineering 
5200  Springfield  Pkie 
Dayton,  OH  45431 
(937)  476-2582  (fax  (937)  476-2900) 
chris.linhardt@veridian.com 

The  goals  of  STIPE  are  to  reduce  the  time  and  cost  for  developing  and  maturing  promising  Uninhabited  Air  Vehicle 
(UAV)  technologies,  to  integrate  the  technologist  and  the  warfighter  into  the  Science  and  Technology  (S&T)  acquisition 
process,  and  to  provide  analytical  input  into  the  Air  Force  S&T  planning  process.  STIPE  combines  engineering-level 
modeling,  design  and  analysis  tools,  mission-  and  campaign-level  simulations,  and  cost  analysis  tools  in  a  simulation 
environment  to  provide  analytic  information  to  support  investment  decisions  in  the  Science  and  Technology  arena.  This 
simulation  environment  will  provide  the  capability  for  researchers  to  evaluate  the  impact  of  different  UAV  technologies  in  a 
warfighting  environment,  providing  a  link  between  AFRL  technologies  and  warfighter  mission  needs. 

The  STIPE  simulation  environment  is  being  applied  on  the  SensorCraft  Technology  Assessment  as  a  proof  of  concept. 
AFRLs'  SensorCraft  initiative  is  an  advanced  multi-sensor  UAV  for  standoff  ISR.  This  presentation  focuses  on  the  campaign 
level  analysis  performed  in  support  of  the  SensorCraft  Technology  Assessment.  The  goal  of  the  campaign  analysis  is  to 
provide  operational  measures  of  merit  for  return  on  investment  (ROI)  analysis  to  identify  promising  candidate  SensorCraft 
concepts.  The  variables  derived  from  the  candidate  technologies  include  the  basing  concept,  air  vehicle  endurance,  air  vehicle 
RCS,  mean  time  between  critical  failure  (MTBCF),  mean  time  to  repair  (MTTR),  ground  moving  target  indicator/tracker 
(GMTI/T)  performance,  spot  synthetic  aperture  radar  (SAR)  performance,  and  air  moving  target  indicator  (AMTI) 
performance.  The  primary  measures  of  merit  at  the  campaign  level  are  kills  by  target  type  and  campaign  duration  required  for 
operational  task  objectives. 


Terry  Brown 

Veridian  Engineering 

5200  Springfield  Pkie 

Dayton,  OH  45431 

(937)  476-2514  (fax  (937)  476-2900) 

terrv.brown@veridian.com 
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JWARS  Terrain  Roughness  and  Probability  of  Line-of-Sight  Modeling  Research 


H.  Ric  Blacksten 

CACI  International,  Inc. 

Arlington,  VA  22209 
(703)875-3030  fax(703)  875-2904) 
rblacksten@caci.com 


Charles  D.  Burdick 

Lockheed  Martin  Corp.  /  JWARS  Office 
Arlington,  VA  22209 
(703)  696-9490  (fax  (703)  696-9563) 
chuck.burdick@lmco.com 


Mihaly  G.  Grell 

GRCI,  Inc.  /  JWARS  Office 

Arlington,  VA  22209 

(703)  696-9490  (fax  (703)  696-9563) 

grell.mihalv@att.net 


The  Joint  Warfare  System  (JWARS)  is  a  constructive,  analytic  stochastic  simulation  of  joint  theater  level  warfare.  As 
with  other  military  simulations,  roughness  and  line-of-sight  (LOS)  play  important  roles  in  many  aspects  of  combat  simulation 
such  as  tactical  mobility,  direct  fire  and  indirect  fire  adjudication,  and  target  sensing  and  tracking.  This  paper  reports  on  a 
new  approach  to  generating  measures  of  roughness  and  probability  of  LOS  (PLOS)  suitable  for  JWARS  application.  The 
approach  extends  work  done  by  TRADOC  Analysis  Command  in  relating  roughness  to  PLOS.  The  extension  involves:  (1) 
developing  a  corrected  measure  of  roughness  as  a  function  of  range  of  interest  by  subtracting  out  a  "soap  film"  substrate  to 
remove  unintended  effects  of  general  terrain  slope,  (2)  fitting  the  corrected  roughness  empirical  data  to  a  two-parameter 
parametric  curve,  (3)  fitting  empirical  PLOS  curves  for  various  observer  heights  to  a  second  two-parameter  parametric  curve 
involving  the  composition  with  the  corrected  roughness  curve.  The  result  is  a  four-parameter  composite  model  that  provides 
very  satisfying  fits  to  empirical  PLOS  data.  Future  extensions  are  planned  to  provide  probabilities  of  LOS  conditional  on 
previous  observer-target  LOS  status,  conditional  on  target  and  observer  non-random  positioning,  and  to  address  issues  of 
desirable  PLOS  repeatability. 


Synthetic  Weather  Forecasting  for  Naval  Logistics  Decision  Simulation 


H.  Ric  Blacksten  and  Judy  Schandau 
CACI  International,  Inc. 

Arlington,  VA  22209 

(703)  875-3030  (fax  (703)  875-2904 

rblacksten@caci.com 

C.  Hogan 

CACI  International,  Inc. 

Arlington,  VA  22209 

(703)  558-0273  (fax  (703)  875-2904 

chogan@caci.com 


Bob  Drash 
GRCI,  Inc. 

Vienna,  VA  22182 

(703)  696-9360  (fax  (703)  696-9394) 

Rdrash@grci.com 


The  Office  of  Naval  Research  is  sponsoring  development  of  a  Naval  Logistics  Wargame  Simulation  (LWS)  for  the 
analysis  of  sea-based  logistics  concepts  of  operations  (CONOPS).  Simulated  Naval  logistics  planners  consider 
environmental  effects  when  generating  availability  estimates  for  logistics  support.  High  sea  state,  strong  winds,  extreme 
temperatures,  and  degraded  visibility  degrade  or  curtail  cargo  transport  operations.  Perfect  knowledge  of  weather  is  not 
available,  so  the  LWS  projects  a  perceived  weather  picture  for  decision-making  by  the  simulated  logistics  planners.  Fuzzy 
logic  is  applied  to  simulate  asset  availability  decisions  in  gray  go/no-go  areas.  A  chess-like  lookahead  explores  possible 
reorderings  of  maneuver  requirements  to  achieve  logistics  needs.  The  LWS  uses  a  stochastic  shift  matrix  to  generate 
forecasts  by  shifting  ground  truth  synthetic  weather  in  time.  This  algorithm  generates  forecasts  that  generally  improve  as  the 
date  of  the  forecast  becomes  closer  and  that  exhibit  the  correlated  errors  observed  in  actual  forecasts.  The  algorithm  involves 
six  parameters,  five  of  which  are  used  to  calibrate  the  model  to  observed  forecast  performance.  The  remaining  parameter  is 
used  to  reflect  the  quality  of  the  weather  forecasting  system.  The  resulting  synthetic  weather  forecasting  model  may  be  easily 
integrated  into  any  constructive  simulation  employing  an  environmental  server  to  provide  synthetic  weather. 


81 


Military  Environmental  Factors  WG-11 

The  Expanded  Role  of  Concept  Modeling  in  Simulation  Development  Including  the  Natural 
Environment  Subsystem 

Dr.  Donna  W.  Blake  Mr.  Stan  Grigsby  Dr.  S.  K.  Numrich 

535A  East  Braddock  Road  535A  East  Braddock  Road  1901  N.  Beauregard  Street,  Suite  500 

Alexandria,  VA  22314-2161  Alexandria,  VA  22314-2161  Alexandria,  VA  22311 

703-535-6640,  fax  (703)  535-5884  703-535-6640,  fax  (703)  535-5884  703-998-0660,  fax  (703)  998-0667 

blake@visitech.com  grigsbv@visitech.com  snumrich@dmso.mil 

This  presentation  describes  the  application  of  the  Simulation  Engineering  Concept  Model  (SECM)  to  analyze  the  Navy’s 
Probability  of  Raid  Annihilation  (Pra)  Federation.  The  SECM  is  based  on  object-oriented  system  engineering  practices  and 
has  evolved  from  the  Environment  Concept  Model  (ECM).  The  ECM  was  initially  used  to  develop  a  consistent  and 
sufficient  environmental  representation  for  the  Navy’s  Integrated  Ship  Defense  program.  Historically,  treating  the  natural 
environment  only  as  input  data  has  ignored  the  analysis  necessary  to  determine  the  appropriate  environment  representation 
required  by  a  simulation.  When  the  ECM  was  applied  to  the  PRA  program  it  revealed  that  the  natural  environment  must  be 
treated  as  a  critical  subsystem  in  the  system  representation.  To  be  effective,  the  simulation  design  must  identify  and  trace  all 
subsystems  as  a  part  of  the  FEDEP.  The  SECM  has  evolved  concept  modeling  to  form  the  basis  for  this  process  for  all  steps 
in  the  FEDEP. 

Embedded  Simulation  System  for  SMART 

Paul  Bounker 

U.S.  Army  TACOM 

AMSTA-TR-R/MS  264,  Warren,  MI  48397-5000 
(586)  574-5297,  bounkep@tacom.armv.mil 

The  U.S.  Army’s  Tank- Automotive  Research,  Development  and  Engineering  Center  (TARDEC)  Embedded  Simulation 
(ES)  team,  has  developed  an  Embedded  Simulation  System  that  interfaces  with  advanced  vehicle  hardware  and  software  as 
part  of  the  Inter-Vehicle  Electronics  Suite  (IVES)  Science  and  Technology  Objective  (STO).  The  ES  system  allowed  the 
IVES  STO  to  field  test  advanced  concepts  such  as  Indirect  Vision  Driving,  Drive-By-Wire,  Voice  Recognition,  3D  Audio, 
Head  Tracking  and  advanced  crewstation  design  using  simulation  to  provide  stimulation  to  crewmen.  Technologies  that 
were  simulated  to  provide  workload  analysis  for  the  two-  man  crew  included  Automatic  Target  Recognition  (ATR), 
Automatic  Target  Tracking  (ATT),  C2,  integrated  OPFOR  and  Friendly  CGF  and  Battlefield  Visualization. 

The  ES  system  has  also  been  integrated  with  AMC  RDEC  Federation.  The  RDEC  Federation  provides  full  spectrum 
modeling  and  simulation  services  to  any  customer.  Full  spectrum  ranges  from  engineering  level  models  through  virtual 
prototypes  onto  battlefield  simulations.  All  models  are  validated  to  the  system  they  represent  through  close  interaction 
between  the  modeler  and  system  developer.  All  simulation  scenarios  are  based  upon  realistic  circumstances,  run  real-time, 
and  generate  semi-automated  forces  as  required.  Each  RDEC  (and  ARL  and  STRICOM)  brings  a  robust  suite  of  supported 
models  within  their  area  of  technological  and  subject  matter  expertise.  These  areas  include  missiles,  armaments, 
communications,  aviation,  sensors,  vehicles,  and  command  and  control.  The  use  of  ES  System  allows  the  customer  to 
evaluate  advanced  concepts  in  the  latest  crewstation  designs  with  the  latest  interfaces. 

The  ES  system  is  being  enhanced  and  used  as  part  of  the  Crew  integration  and  Automation  Testbed  (CAT)  Advanced 
Technology  Demonstration  (ATD)  and  Robotic  Follower  ATD  in  support  of  the  FCS  program.  A  field  demonstration  is 
planned  for  February  2003. 

When  Good  Terrain  Goes  Bad 

Danny  C.  Champion 

TRAC-WSMR 
WSMR,  NM  88002 
(505)  678-2763,  fax  (505)  678-5104 
champd@trac.wsmr.armv.mil 

Those  who  use  digital  elevation  models  (DEMs)  generally  assume  they  are  using  good  quality  data.  Even  if  a  reputable 
provider  is  paid  to  build  a  high-resolution  database  to  certain  specifications,  how  does  the  user  really  know  the  quality  of  the 
data.  This  is  a  case  study  where  a  very  high-resolution,  high-accuracy  DEM  was  required  and  purchased.  However, 
procedures  used  on  the  initial  source  data  to  develop  the  final  product  resulted  in  data  inadequate  for  its  intended  application. 
This  presentation  describes  a  ground-truth  validation  process  that  was  instrumental  in  identifying  various  flaws  in  the  DEM 
which  were,  in  turn,  acknowledged  and  corrected  by  the  provider.  Also  discussed  will  be  the  discrepancies  in  line-of-sight 
when  using  a  poor  DEM. 
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Integration  of  Urban  Characterization,  Munitions  Effects,  and  Threat  Assessment  for  Ground 
Vehicle  Movement  Planning  in  Urban  Environments 


Dr.  Niki  C.  Deliman 

US  Army  Engineer  Research  and 
Development  Center 
Vicksburg,  MS  39180-6199 
(601)  634-3369,  fax  (601)  634-2794 
Niki.C.Deliman@erdc.usace.army.mil 


CPT  Scott  Crino 

US  Army  TRADOC  Analysis  Center-Monterey 
Monterey,  CA  93943 
(831)  656-4062,  fax  (831)  656-3084 
crinos@trac.nps.navy.mil 


Transition  to  the  Objective  Force  will  involve  development  and  assessment  of  capabilities  for  operations  in  urban 
environments  as  U.S.  Military  involvement  in  urban  conflict  and  peacekeeping  operations  continues  to  increase.  Current 
representation  in  modeling  and  simulation  (M&S)  is  deficient;  it  is  imperative  that  developing  M&S  realistically  portray 
these  environments  to  facilitate  advanced  concept  exploration,  doctrinal  development,  force  structure  assessment,  and 
materiel  alternatives.  Rubblizing  associated  with  structural  weapons  effects  is  a  primary  consideration  and  potential  detractor 
to  mission  accomplishment,  particularly  in  the  area  of  movement  and  maneuver,  to  include  route  finding.  Identification  of 
urban/structural  features  and  attributes  is  a  key  component  for  structural  weapons  effects  algorithms  needed  to  generate  the 
rubble  footprint.  The  U.S.  Army  TRADOC  Analysis  Center,  U.S.  Army  Engineer  Research  and  Development  Center,  and 
U.S.  Army  Materiel  Systems  Analysis  Activity  are  currently  involved  in  an  FY02  collaborative  project  to  incorporate  urban 
environments,  associated  realistic  munitions  effects,  ground  vehicle  movement  characteristics,  and  routing  with  consideration 
of  movement  rates  and  threat  locations.  Major  components  of  the  project  include  characterization  of  urban  environments, 
development  of  a  structural  weapons  effects  module  and  debris  field  distribution,  expansion  of  the  Standard  Mobility  API  to 
incorporate  effects  of  rubble  obstacles,  development  of  associated  route  finding  algorithms,  and  implementation  with 
COMBAT™. 


Applicability  of  Target  Acquisition  Modeling  to  the  MOUT  Environment 

David  Neal  and  Morris  Driels 

TRAC-Monterey 
PO  Box  8692 
Monterey,  CA  93943-5118 
morris@nps.navv.mil 

The  overall  objective  of  this  study  is  to  conduct  the  foundation  research  that  will  guide  the  enhancement  of  the  NVESD 
ACQUIRE  acquisition  model  to  allow  the  effectiveness  of  MOUT  to  be  determined  in  a  force-on-force  context.  The  main 
component  of  the  study  identified  at  this  point  is  the  detection  of  targets  and  visual  assessment  of  their  threat  level.  It  is  clear 
that  the  technical  approach  to  this  project  will  include  several  sub-tasks  such  as: 

1.  Determination  of  those  activities  that  enable  observers  to  discriminate  between  friendly,  threat  and  non-combatants 
entities. 

2.  A  model  to  predict  probabilities  that  these  activities  may  be  recognized,  given  the  physical  environment  in  which  they 
take  place. 

3.  Estimation  of  the  visual/thermal  characteristics  needed  by  existing  sensors  to  input  to  such  a  model. 

Since  the  ACQUIRE  model  will  be  central  to  the  product  developed  by  the  project,  it  will  be  necessary  to  review  and 
document  those  assumptions  and  constraints  associated  with  it,  since  some  of  them  may  be  violated  by  using  this  model  in  a 
manner  for  which  it  was  not  designed.  Some  of  the  potential  problems  associated  with  using  the  ACQUIRE  model  directly  in 
a  MOUT  environment  will  be  discussed. 

Balloon-Ring ,  Radar,  and  Aircraft  Measurements  of  Refractivity  Turbulence 

Frank  D.  Eaton 

Directed  Energy  Directorate 
Air  Force  Research  Laboratory 
Kirtland  AFB,  NM  87117 
(505)  853-1091 
Frank.Eaton@kirtland.af.mil 


Results  of  a  new  measurement  platform  for  optical  and  mechanical  turbulence  observations  are  presented  and  discussed. 
The  platform  is  a  polyethelene  tube  shaped  as  a  ring  with  a  pressure  relief  valve.  The  "ring"  is  actually  8-sided  with  a 
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diameter  of  about  30  feet  and  trails  a  balloon  with  several  risers.  Several  fine  wire  sensors  (  1  1/4  [im  diameter)  are  mounted 
at  various  spacings  to  measure  high  speed  temperature  and  velocity  fluctuations.  From  these  measurements  the  refractive 

index  structure  parameter  (C2 ),  inner  scale  (/0),  outer  scale  (L0),  the  eddy  dissipation  rate  (e),  and  other  parameters  of 

interest  can  be  estimated.  Measurements  are  compared  to  simultaneous  observations  taken  with  a  VHF  radar  estimating  the 
same  parameters.  Several  questions  are  addresses  that  are  important  for  laser  propagation  such  as:  a)  Is  the  atmosphere 
isotropic  for  the  scales  of  interest?  b)  Is  the  turbulence  Kolmogorov  under  various  atmospheric  conditions,  or  how  often  is 
the  structure  function  represented  by  the  r2'3  law?  c)  What  are  the  profiles  of  inner  and  outer  scale?  d)  Does  wake 
contamination  affect  thermosonde  measurements?  and  e)  Does  fine  scale  structure  within  the  scattering  volume  sense  by  a 

radar  affect  C2  and  e  estimates?  A  program  using  the  same  fine  wire  sensors  on  an  airplane  will  be  discussed.  The 

importance  of  determining  the  path  variability  of  C2  and  /0  for  interpreting  scintillometer  measurements  over  long  paths 

will  be  presented.  The  site  discussed  is  the  Airborne  Laser  Advanced  Concepts  Testbed  (ABL  ACT)  that  is  located  on  White 
Sands  Missile  Range,  NM.  A  52.4  km  propagation  path  is  utilized  between  two  mountain  peaks. 

Cryogenic  Abatement  of  Spill-Induced  Toxic  Vapor  Plumes:  A  Feasibility  Study 

Doyle  S.  Elliott 

U.S.  Army  Research  Laboratory 

ATTN:  AMSRL-CI-EB 

White  Sands  Missile  Range,  NM  88002-5501 

(505)678-6509  (fax  (505)  678-1230) 

selliott  @  arl .  army .  mi  1 

The  remediation  of  volatile  toxic  liquid  spills  and  abatement  of  toxic  plumes  is  of  increasing  concern.  Current 
methodology  for  emergency  remediation  of  chemical  spills  usually  involves  evacuation  plus  the  use  of  physical  methods, 
such  as  barriers  (dikes)  and  absorption  using  clay  and  removal  with  heavy  equipment,  and  when  applicable,  bio-remediation 
methods  or  chemical  methods  are  used  to  neutralize  the  spilled  chemical.  Only  in  recent  years  has  frozen  soil  barrier 
technology  been  used  for  environmental  remediation  of  contaminated  soil.  To  my  knowledge,  none  of  the  current  methods 
immediately  and  specifically  address  the  abatement  of  the  vapor  plume  induced  by  the  spill.  The  feasibility  study,  by  using 
calculated  estimates  and  computer  modeling,  indicates  that  the  use  of  inexpensive  cryogenic  liquids  such  as  liquid  nitrogen 
(LN2)  shows  promise  in  the  abatement  of  toxic  volatile  materials  spilled  as  liquids  into  the  surface  layer.  Chilling  and/or 
freezing  of  the  spilled  chemical  at  the  surface  minimizes  the  evaporation  and  diffusion  of  the  liquid  (or  sublimation  of  solid), 
and  therefore,  the  plume  concentration  and  volume.  Introduction  of  spray  (water  or  other  liquid)  into  the  plume  to  directly 
washout  the  chemical  and  to  form  a  frozen,  impermeable  crust  on  top  of  the  spill  area  may  further  reduce  the  plume 
concentration  and  volume. 

Enabling  Technologies  of  the  Integrated  Natural  Environmental  Authoritative  Representation 
Process  (INEARP)  Implementation 

Paul  Foley 

Defense  Modeling  and  Simulation  Office 
Suite  500,  1901  N.  Beauregard  St. 

Alexandria,  VA  22311 

(703)  998-066  (fax  (703)  998-0667) 

pfolev  @  DMSO.mil 


The  Defense  Modeling  and  Simulation  Office  (DMSO)  Environmental  Representation  Technology  Area,  in  conjunction 
with  the  DoD  Modeling  and  Simulation  Executive  Agents  (MSEAs)  for  the  Authoritative  Representation  of  the  Atmosphere 
and  Space,  Ocean  and  Terrain,  is  sponsoring  development  of  enabling  technologies  to  implement  the  Integrated  Natural 
Environmental  Authoritative  Representation  Process  (INEARP).  The  MSEAs  and  DMSO  have  developed  an  INEARP 
implementation  as  a  cooperative  effort  to  demonstrate  how  users  of  M&S  technology  will  acquire  authoritative 
environmental  representations  using  an  effective,  readily  accessible  process  and  supporting  technical  infrastructure.  The 
INEARP  will  provide  the  capability  to  rapidly  generate  a  fully  integrated  environmental  representation  to  include  aspects  of 
ocean,  atmosphere,  space  and  terrain  that  is  internally  consistent,  cost  effective,  and  authoritative  and  meets  the  requirements 
of  the  warfighter.  This  presentation  will  offer  an  update  on  the  progress  of  current  efforts. 
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Assessing  Effects  of  Enhanced  Fidelity  for  Ground  Vehicle  Mobility  in  Combat  Models 

MAJ  Simon  R.  Goerger  Dr.  Niki  C.  Deliman  David  R.  Durda 

Naval  Postgraduate  School  US  Army  Engineer  Research  and  USA  TRADOC  Analysis  CTR  WSMR 
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As  computer  systems  exhibit  greater  computing  power,  they  provide  combat  model  developers  the  capabilities  to 
enhance  the  fidelity  of  their  simulations  by  improving  the  fidelity  of  underlying  algorithms.  Movement,  such  as  ground 
vehicle  movement,  is  one  of  the  basic  battlefield  functions  and  is  portrayed  at  differing  levels  of  fidelity  across  M&S. 
Ground  vehicle  movement  is  limited  by  the  terrain/environmental  factors  present  in  reality,  but  this  fact  is  not  necessarily 
reflected  in  current  simulations.  The  need  to  account  for  such  effects  has  been  acknowledged  by  the  community  and  is  being 
incorporated  in  developing  simulations.  As  simulation  fidelity  is  enhanced,  however,  it  is  also  important  to  address  the 
question  of  what  increased  or  decreased  fidelity  representation  buys  the  user/analyst. 

This  paper  will  address  effects  of  improving  ground  vehicle  mobility  representation  in  entity-level  M&S  by 
incorporating  mobility  limiters,  utilizing  the  recent  integration  of  the  standard  mobility  application  programmers  interface, 
STNDMob  API,  with  COMBATxxl.  The  development  and  integration  were  conducted  largely  by  the  US  Army  Engineer 
Research  and  Development  Center  and  the  US  Army  TRADOC  Analysis  Center  -  White  Sands  Missile  Range. 
COMBATXXI  is  the  Army’s  next-generation  brigade  and  below  entity  level  analytical  model.  The  standard  mobility 
application  programmers  interface,  STNDMob  API,  allows  entity  level  models  to  use  terrain  limited  speed  factors  and  is 
based  on  the  Army’s  standard  mobility  model,  NATO  Reference  Mobility  Model  (NRMM).  This  integration  has  revealed 
some  potential  impacts  on  simulation  outcomes  resulting  from  dynamically  limiting  the  speed  of  vehicles  and  restricting 
areas  of  operation  based  on  environmental  conditions  versus  utilizing  command  ordered  or  static  speeds  and  will  form  the 
basis  for  the  study. 

Experimental  evidence  for  the  differential  effect  of  temperature  on  bulk  and  vicinal  water: 
Implications  for  terrain  state  and  signature  physics. 

Steven  A.  Grant 

U.S.  Engineer  Research  and  Development  Center 
Cold  Regions  Research  and  Engineering  Laboratory 
72  Lyme  Road,  Hanover  NH  03755-1290 
603-646-4446,  fax(603)646-4561), 
steven.a.grant@usace.armv.mil 

Soil  physical  properties  have  long  been  correlated  with  soil  texture.  Recent  studies  indicate  that  the  effect  of  temperature 
on  the  physical  and  electromagnetic  properties  of  water  near  the  surfaces  of  soil  particles  differ  markedly  from  those  of  bulk 
water.  If  verified,  these  phenomena  suggest  that  description  of  the  physical  and  electromagnetic  soil  properties  should  include 
temperature  and  specific  surface,  which,  in  principle,  would  lead  to  immediate  improvement  in  the  Army's  ability  to  sense 
remotely  and  model  the  mobility  of  soils  and  roads  in  the  natural  environment.  These  results  would  have  implications  for  the 
types  of  soil  data  to  be  included  in  the  next  generation  of  Army  GIS  databases. 

New  Transmission  Algorithms  for  Modeling  Obscurants  in  Urban  Environments 

Donald  Hoock 

U.S.  Army  Research  Laboratory 
AMSRL-CI-EE 

White  Sands  Missile  Range,  NM  88002-5501 

(505)  678-5430  (fax  (505)  678-3385),  dhoock@arl.armv.mil 

The  behavior  and  effects  of  obscurants  in  complex  and  urban  domains  continues  to  be  a  difficult  modeling  challenge. 
Complex  non-uniform  wind  flow  and  turbulence  within  a  surface  boundary  layer  represented  by  buildings  in  an  urban 
environment  or  trees  in  a  forest  canopy  introduce  complexity  that  cannot  be  handled  in  current  obscurant  models.  The  usual 
representation  of  obscurant  clouds  as  simple  plumes  and  individual  puffs  is  inadequate.  New  models  of  transport  and 
dispersion  of  obscurants  and  other  aerosols  in  these  flows  propose  that  cloud  concentrations  be  tracked  as  an  ensemble  of 
many  puffs  released  from  the  source.  Therefore,  in  this  paper  we  introduce  new  efficient  algorithms  for  computing  line  of 
sight  transmission  through  large  numbers  of  puffs  of  different  sizes  and  locations.  The  methodology  can  also  account  for 
buildings  and  walls  that  partially  intersect  the  cloud  and  “reflect”  the  obscurant  or  aerosol  back  out  into  the  street  flow. 
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Can  Pre-flight  Physics-Based  Infrared  Synthetic  Scene  Simulation  Enhance  Army  Aviation  Mission 
Effectiveness? 

George  G.  Koenig,  Robert  E.  Davis  and  Major  Steve  Milton 
U.S.  Army  Engineer  Research  and  Development  Center 
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(603)  646-4556  (fax  (603)  646-4278) 

George.G.Koenig@erdc.usace.armv.mil 

Aviators  rely  heavily  on  Forward  Looking  InfraRed  (FLIR)  imagery  to  navigate  and  to  rapidly  and  accurately  detect  and 
identify  targets.  Weather  and  weather  impacted  terrain  and  targets  can  significantly  alter  terrain-target  infrared  contrast 
relationships  impeding  an  aircrew’s  ability  to  effectively  use  FLIR  imagery  for  mission  accomplishment.  Weather  affected 
FLIR  performance  potentially  increases  the  Army  aviator’s  exposure  to  enemy  threats  and  counterattacks,  and  ultimately 
decreases  system  lethality  and  survivability.  Pre-flight  physics-based  infrared  synthetic  scenes  can  mitigate  the  impact  of 
weather  by  portraying  the  weather  impacted  terrain-target  infrared  contrast  accurately. 

The  U.S.  Army  Engineer  Research  and  Development  Center  (ERDC),  the  Air  Force  Research  Agency  (AFRA),  and  the 
U.S.  Army  Aviation  Test  Directorate,  Operational  Test  Command  tested  the  utility  of  the  Infrared  Target-scene  Simulation 
Software  (IRTSS)  system  as  a  mission  planning  and  rehearsal  tool  for  AH-64  Apache  attack  aviation.  Pre-flight  infrared 
synthetic  scene  mission  enhancement  was  quantified  using  metrics  based  on  Battle  Position  (BP)  rankings,  as  compared  to 
the  rankings  of  a  Standardization  Instructor  Pilot  (SIP),  target  detection  times,  number  of  target  false  detects,  and  number  of 
target  non-detects.  Questionnaires  provided  a  qualitative  assessment  of  the  ‘value’  of  pre-flight  synthetic  infrared  scenes  as 
judged  by  Army  aviators. 

Two  groups  of  fifteen  Apache  pilots  participated  in  the  test  to  determine  the  impact  of  pre-flight  physics-based  infrared 
synthetic  scene  simulation  on  Army  aviation  mission  effectiveness.  One  group  of  test  subjects  received  the  current  pre-flight 
briefing  tools,  while  the  second  group  received  current  briefing  tools  plus  IRTSS  generated  scenes  representing  the  Apache 
Target  Acquisition  Detection  Site  (TADS)  imagery  consistent  with  the  mission  Fragmentary  Order.  U.S.  Army  Aviation  Test 
Directorate,  Operational  Test  Command/ ATEC  conducted  the  formal  analysis.  Researchers  at  CRREL  conducted  additional 
analysis.  The  BP  correlation  between  the  test  subjects  for  each  group  and  the  SIP,  the  target  detection  times,  including 
procedures  to  account  for  false  and  non  detects,  and  the  number  of  false  and  non-detects  was  used  to  ascertain  the  benefits 
derived  from  using  pre-flight  infrared  scenes  on  mission  effectiveness.  The  analysis  of  the  quantitative  and  qualitative  data 
supports  the  conclusion  that  pre-flight  physics-based  infrared  synthetic  scene  simulations  enhance  Army  aviation  mission 
effectiveness. 
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Weather  conditions  in  the  dismounted  infantry  battlespace  can  pose  significant  challenges  to  warfighter  health  and 
performance.  As  our  military  force  structure  becomes  increasingly  tuned  to  rapid  deployment  scenarios  anywhere  in  the 
world,  there  is  a  growing  need  to  fully  develop  and  validate  predictive  modeling  tools  that  allow  timely  assessment  of  the 
physiological  effects  of  potentially  extreme  local  environments.  Future  Army  systems  envision  the  application  of  these 
models  in  military  operational  settings,  and  development  of  capabilities  to  quantify  individual  warfighter  thermal  strain  in 
both  real-time  and  prognostic  modes  are  identified  in  the  Operational  Requirements  Document  (ORD)  for  Land  Warrior. 
This  work  is  focused  on  development  of  a  deployable  mathematical  model  that  reflects  our  understanding  of  minute-to- 
minute  human  physiological  responses  across  the  full  range  of  environments  from  extreme  cold  to  extreme  heat,  in  a  context 
that  considers  individual  warfighter  physical  characteristics,  clothing  type,  and  mission  driven  rates  of  energy  expenditure. 
This  presentation  describes  progress  we  have  made  in  model  integration  and  in  validation  efforts  using  data  from  laboratory 
studies  and  field  studies  conducted  as  part  the  Warfighter  Physiological  Status  Monitoring  (WPSM)  program. 
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Identifying  and  quantifying  the  potential  benefits  associated  with  newly  proposed  or  planned  military  systems  is  an 
integral  part  of  the  conceptual  and  developmental  phases  of  the  DOD  acquisition  process.  Quantifying  the  benefits  for 
Intelligence,  Surveillance,  and  Reconnaissance  (ISR)  type  systems  are  especially  challenging  since  no  direct  connection  often 
exists  between  the  ISR  information  and  how  it  affects  some  of  the  traditional  combat  Measures  of  Effectiveness  (MOEs).  To 
address  this  issue,  Joint  Semi-Automated  Forces  (JSAF),  an  entity-level  combat  simulation  model,  is  used  to  perform  a  series 
of  simulations  that  effectively  quantified  how  ISR-like  information  affected  combat  outcomes  based  on  traditional  MOEs. 
The  ISR  information  we  examined  was  soil  moisture,  which  is  valuable  to  the  Army  because  of  its  impact  on  mobility  and 
trafficability.  The  soil  moisture  conditions  that  we  modeled  emulate  the  measurement  capability  expected  to  be  available 
from  the  National  Polar-orbiting  Operational  Environmental  Satellite  System  (NPOESS).  The  Departments  of  Commerce 
and  Defense  are  jointly  funding  the  development,  operation  and  maintenance  of  NPOESS,  which  uses  the  measurement  of 
soil  moisture  as  one  of  its  key  performance  parameters.  The  NPOESS  Integrated  Program  Office  is  using  our  results  to  help 
quantify  the  tactical  utility  the  Army  can  acquire  when  considering  such  data.  The  results,  which  compare  the  utility  of  using 
NPOESS  soil  moisture  information  in  relation  to  legacy  sources,  were  derived  from  over  60  simulation  runs  that  included  a 
combination  of  different  military  scenarios  and  soil  moisture  conditions.  As  one  progresses  from  dry  to  a  wet  slippery 
condition,  the  improved  spatial  and  temporal  resolution  of  the  NPOESS  data  results  in  marked  contrasts  in  the  MOEs 
(maximum  momentum,  attrition,  and  fuel  consumption)  for  these  simulations.  These  results  demonstrate  that  the  Army  can 
significantly  benefit  from  the  use  of  the  NPOESS  soil  moisture  data  in  its  planning  and  execution  of  combat  operations. 


ISOON  and  SMEI:  Two  New  Resources  for  Assessing  the  Space  Environment 
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The  Improved  Solar  Optical  Observing  Network  (ISOON)  and  the  Solar  Mass  Ejection  Imager  (SMEI)  are  two  new 
instruments  that  will  become  available  in  the  near  future  for  detecting  and  tracking  solar  phenomena  that  have  the  potential  to 
gravely  affect  DoD  assets  in  space  and  on  the  ground.  ISOON  is  a  semi -autonomous  network  of  ground  based  solar 
telescopes  that  will  be  deployed  beginning  in  2003  and  will  patrol  the  Sun  for  solar  flares  and  other  indicators  of  solar 
activity  for  use  by  space  weather  forecasters.  The  SMEI  instrument  will  be  launched  into  sun-synchronous  polar  orbit  in  late 
2002  or  early  2003  and  will,  for  the  first  time,  be  able  to  detect  and  track  Coronal  Mass  Ejections  (CMEs)  as  they  propagate 
through  interplanetary  space  by  providing  photometric,  whole  sky  white-light  images  at  a  96-minute  cadence.  SMEI  will 
allow  for  dramatically  improved  forecasts  of  the  onset,  duration,  and  strength  of  CME-related  geomagnetic  storms  that  affect 
spacecraft,  navigation,  and  communication  systems.  The  principals  of  operation  of  ISOON  and  SMEI  will  be  presented, 
along  with  their  current  status  and  implications  for  military  operations  research. 


Weather  Access  for  Visualization  and  Exploitation  (WAVE) 
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The  Weather  Access  for  Visualization  and  Exploitation  (WAVE)  initiative  will  provide  a  web-enabled  interface  for 
accessing  XML  encapsulated  decision  quality  weather  data  for  warfighter  Command  and  Control  (C2)  and  mission  planning 
applications.  These  applications  currently  rely  on  human  mental  ingestion  and  exploitation  of  pictorial  images  of  weather 
data.  Interpreted  data  must  be  manually  entered  into  the  warfighter  and  C2  applications.  The  C2  Battlelab,  in  partnership 
with  Air  Force  Research  Lab,  and  with  the  support  of  the  Electronic  Systems  Center,  will  develop  an  Application  Program 
Interface  (API)  to  the  Joint  Weather  Impact  System  (JWIS).  Utilizing  state  of  the  art  XML  tags,  WAVE  will  enhance  the 
Environmental  Data  Cube  in  JWIS,  and  build  a  business-to-business  style  API  allowing  warfighter  and  C2  applications  to 
access  decision  quality,  geo-referenced  weather  data.  The  capabilities  of  WAVE  will  be  demonstrated  within  the  USAF  C2 
Battlelab’s  Master  Air  Attack  Planning  Toolkit  to  access  weather  data  during  Joint  Expeditionary  Forces  experiment  2002 
and  Millennium  Challenge  2002. 


Obstacle  Crossing  Performance  of  Vehicles 


Paul  W.  Richmond 

USA  Engineer  R&D  Center 
Hanover,  NH  03755 
(603)  646-4461  fax  (603)  646-4640 
Paul.W.Richmond@erdc.usace.armv.mil 


George  L.  Mason 

USA  Engineer  R&D  Center 

Vicksburg,  MS  39180 

(601)  634-2274  fax  (601)  634-2409 

George.L.Mason@erdc.usace.armv.mil 


E.  Alex.  Baylot 

USA  Engineer  R&D  Center 

Vicksburg,  MS  39180 

(601)  634-3474  fax  (603)  634-2409 

Erwin.A.Bavlot@erdc.usace.army.mil 


Obstacles  can  disrupt,  impede,  and  otherwise  influence  the  outcome  of  military  operations,  understanding  when  and  how 
fast  an  obstacle  can  be  crossed  is  required  to  increase  Army  model  and  simulation  fidelity.  Obstacles  other  than  minefields, 
such  as  ditches,  berms,  cuts  and  fills,  craters,  etc  can  be  either  natural,  man  made  or  reinforced,  and  depending  on  vehicle 
capabilities,  these  obstacles  may  be  crossable,  but  at  a  greatly  reduced  speed.  Obstacle  crossing  speed  is  also  an  issue  when 
comparing  performance  between  wheel  and  tracked  vehicles,  additionally  the  performance  of  small  robotic  vehicles  must 
also  be  considered  in  emerging  simulations.  This  presentation  describes  current  efforts  by  the  Engineer  Research  and 
Development  Center  (ERDC)  to  enhance  vehicle  speed  predictions  during  an  obstacle  crossing  in  a  SAF  environment. 

The  NATO  Reference  Mobility  Model  II  (NRMM  II)  is  an  Army  standard  model  for  determining  vehicle  mobility 
performance,  primarily  by  predicting  maximum  vehicle  capable  speeds.  The  effect  of  a  linear  obstacle  on  maximum  speed  is 
determined  by  using  two  look-up  tables.  The  first  is  a  table  of  average  and  maximum  (resistance  to  motion)  forces  and 
minimum  clearances  based  on  standard  obstacle  descriptions.  If  the  minimum  clearance  is  greater  than  the  vehicle  clearance, 
the  maximum  force  is  used  to  determine  if  there  is  enough  available  traction  to  cross  the  obstacle.  If  either  the  clearance  or 
maximum  traction  tests  fail,  NRMM  II  predicts  no-go.  Otherwise,  the  average  force  is  added  to  the  total  resistance,  which  is 
used  to  calculate  the  maximum  vehicle  capable  speed  across  the  obstacle.  The  second  table  contains  vehicle  speed  versus 
obstacle  height  and  is  used  to  limit  speed  due  to  vehicle  and  driver  acceleration  tolerance  (2.5g).  These  tables  are  in  the 
individual  NRMM  II  vehicle  data  files,  and  are  produced  using  2-dimensional  vehicle  dynamics  software  (OBSMOD  and 
VEHDYN  II). 

The  extraction  of  this  information,  obstacle  description  requirements,  the  implementation  of  this  high  resolution 
data/model  into  a  lower  resolution  SAF  environment  are  discussed. 


Mobile  Environmental  Effects  Technology 

David  Sauter.  Mario  Torres,  David  Marlin  and  Barbara  Sauter 
Army  Research  Laboratory 

Attn:  AMSRL-CI-EB,  White  Sands  Missile  Range,  NM  88002 
(505)  678-2078,  dsauter@arl.armv.mil 


Military  operations  and  weapon  systems  are  adversely  affected  to  some  extent  by  the  environment,  even  those  advertised 
as  “all  weather  capable”.  Thus,  it  is  essential  to  provide  advance  warning  of  these  impacts  to  commanders,  and  end  users, 
such  that  intelligent  decisions  can  be  made  regarding  what  weapon  systems  or  tactics  to  employ  as  well  as  where  and  when  to 
employ  them.  The  U.S.  Army  Research  Laboratory  (ARL)  has  developed  a  number  of  automated  software  applications 
designed  to  provide  environmental  information  and  environmental  effects  to  the  end  user.  Much  of  this  technology  has  been 
transitioned  to  fielded  Army  automated  command  and  control  systems.  Recent  research  has  focused  on  the  technology 
development  for  mobile  computing  devices  such  that  lower  echelons  can  eventually  have  access  to  this  vital  intelligence.  In 
addition  to  an  environmental  effects  application,  technology  has  been  developed  to  provide  acoustic  propagation  effects, 
weather  alerts  and  even  a  capability  to  enter  and  transmit  a  local  weather  observation  back  to  a  server.  This  presentation  will 
focus  on  the  applications  that  have  been  developed  for  the  mobile  device. 
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The  Implementation  of  a  Mesoscale  Meteorological  Model  (MM5)  for  the  Production  of  Simulation 
Scenarios  Ranging  from  Mission  Planning  and  Rehearsals  to  Long  -Term  Simulations 

Mai  Mark  Schrader 

MSEA  ASNE 
151  Patton  Avenue 
Asheville,  NC  88002 
(828)  271-4209 
Mark.Schrader@afccc.af.mil 


The  Department  of  Defense  has  been  involved  in  modeling  and  simulation  activities  for  many  years.  Recent  economic 
constraints  and  technological  improvements  have  resulted  in  a  strong,  renewed  commitment  to  modeling  and  simulation  as 
the  pathway  to  improved  capabilities  and  decision  making.  An  important  aspect  of  this  renewed  commitment  is  to 
incorporate  the  effects  of  the  natural  environment  (air,  space,  oceans,  and  terrain)  into  modeling  and  simulation  activities. 
The  DoD  Modeling  and  Simulation  Executive  Agent  for  Air  and  Space  Natural  Environment  (ASNE)  serves  the  modeling 
and  simulation  community  as  subject  matter  experts  for  air  and  space  natural  environment  modeling  and  simulation  databases 
(including  relevant  standards),  dynamic  processes,  and  other  applications.  Some  of  ASNE's  past  projects  provided  historical 
hourly  time-stepped  scenarios  (ground  truth)  of  meteorological  conditions.  In  2001  and  2002  ANSE  supported  efforts  to 
provide  perceived  truth  (forecasts)  using  MM5  modeled  output.  The  output  can  serve  as  perceived  truth  (PT)  when  required 
or  as  stand  alone  scenario  to  feed  operational  systems  (Army  Battle  Command  System,  AMIS,  NTFS,  etc.).  The  output  is 
intended  to  be  loaded  onto  operational  weather  systems  like  IMETS,  OPSII,  and  TEDS  for  execution  with  MM5  forecast 
fields  for  short  range  mission  planning  and  rehearsals  and  any  simulation  system  requiring  perceived  truth  meteorological 
conditions. 


Target  Acquisition  under  Degraded  Atmospheric  Conditions:  Parametric  Curves  for  Wargames 


Dr.  Richard  Shirkev 

Army  Research  Laboratory 

Attn:  AMSRL-CI-EE 

WSMR,  NM  88002  -  5501 

(505)  678-5470  (fax  (505)  678-4449) 

rshirkev@arl.armv.mil 


Dr.  Sean  O'Brien 

New  Mexico  State  University 

Physical  Sciences  Laboratory 

Las  Cruces,  NM  88003 

(505)  678-1570  (fax  (505)  678-4449) 

sobrien@arl.armv.mil 


Applying  weather  to  wargames  is  always  problematic  -  detailed  physics  calculations  are  required  involving  significant 
amounts  of  computer  time;  even  the  simplest  of  atmospheric  calculations  frequently  takes  too  long.  Since  wargames, 
particularly  aggregate  games,  cannot  afford  this  overhead,  alternate  approaches  must  be  devised. 

Recently  progress  has  been  made  in  this  area  by  applying  the  Integrated  Weather  Effects  Decision  Aid  (IWEDA)  rules. 
An  example  of  such  a  rule  would  be  "Winds  exceeding  10  knots  precludes  helicopter  takeoff/landing."  While  this  rule  is 
straightforward,  rules  dealing  with  target  acquisition  are  not  always  so  clear-cut.  Variables  for  target  acquisition  include  not 
only  the  target  state  and  sensor  chosen,  but  also  the  state  of  the  weather  -  the  presence  or  absence  of  clouds,  precipitation 
within  the  last  6  hours,  aerosol  type  for  visibility  determination,  time  of  day,  time  of  year  and  so  on. 

Using  algorithms  contained  in  the  Target  Acquisition  Weapons  Software  (TAWS),  we  are  constructing  parametric 
curves  relating  the  above-mentioned  variables  to  target  and  sensor  type.  A  brief  overview  of  TAWS  along  with  the  latest 
results  from  this  methodology  will  be  presented. 


TRAINED  CELL:  A  Multi-modal  Biosensor  and  Decision  System 


Robert  B.  Silver  John  R.  Hummel 

Decision  and  Information  Sciences  Division  Decision  and  Information  Sciences  Division 

Argonne  National  Laboratory  Argonne  National  Laboratory 

9700  S.  Cass  Avenue/DIS-900,  Argonne,  IL  60439-4832  9700  S.  Cass  Avenue/DIS-900,  Argonne,  IL  60439-4832 

(630)  252-7 1 89,  rsilver@anl.gov  (630)  252-7 1 89  (fax  (630)  252-5128),  ihummel@anl.gov 

By  their  fundamental  nature,  the  challenges  posed  by  biological  and  chemical  weapons  of  mass  destruction  (BCWMD)  - 
also  known  as  Mass  Casualty  Weapons  -  and  emerging  infectious  diseases  (EID)  are  of  the  utmost  concern.  Unlike  nuclear 
weapons,  biological  weapons  (B-bombs)  are  more  readily  produced,  easily  hidden  in  stable  dormant  states,  and  present  clear 
and  present  danger  to  human  populations  through  a  variety  of  lethal  and  maiming  modalities.  Accurate,  precise  and  timely 
annunciation  of  BCNWMD  agents  is  of  utmost  importance  for  insuring  and  preserving  the  health,  safety  and  well  being  of 
human  and  other  populations.  People  living  in  modern  cities  and  “edge  cities”  and  mass  transportation  systems  are 
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particularly  vulnerable  to  attacks  using  such  agents.  To  defend  against  such  agents,  suitable  sensors,  acting  like  the 
mineshaft  canaries  of  history,  are  needed  for  a  variety  of  missions.  To  minimize  the  threat  of  BCWMD  and  EID  to  human 
populations,  and  to  assist  in  the  elimination  of  these  threats,  there  is  a  need  for  a  biosensor  capable  of  responding  to-, 
classifying,  and  annunciating  chemical,  biological,  nuclear  and  metabolic  threats  from  known  and  unknown  organisms  or 
other  agents  to  biological  processes  within  one  second,  i.e.,  rapidly,  accurately  and  with  precision. 

This  sensor  can  respond  to  biological  (B),  chemical  (C),  drugs  and  their  precursors  (D)  and  nuclear  (N)  threats,  sic.  a 
BCDN  biosensor.  This  sensor  is  a  new  cell-based  technology,  based  on  a  newly  discovered  sentinel  cell,  is  being  developed. 
This  new  technology  is  called  the  ‘Trained  Cell”  (patents  issued  and  pending).  Trained  Cells  are  tuned  to  respond,  in  a 
characteristic  fashion,  to  particular  ligands  or  other  reactants,  especially  those  that  disrupt  normal  metabolic  processes.  The 
modeling  framework  being  developed  for  Trained  Cell  incorporates  a  full  suite  of  attributes  for  each  agent  and  their  targeted 
and  affected  systems  and  processes  -  from  data  and  metadata  -  acting  within  a  spatial-temporal  framework  that  can  be 
dynamically  assessed  to  faithfully  represent  biological,  meteorological  and  epidemiological  attributes  -  and  the  clinical 
presentations,  anticipated  morbidity  and  lethality  potential. 

This  system,  that  non-technical  personnel  can  operate,  can  classify  responses  based  on  the  genus/species/strain  and 
degrees  of  molecular  homology.  The  system  will  provide  forensics  support  through  the  collection  of  the  detected  agent.  This 
approach  is  compatible  with  current  systems  and  investments  both  horizontally  ( e.g .,  in  concert  with  other  detection 
modalities)  and  vertically  ( e.g .,  communications,  decision  and  logistics).  We  believe  that  the  approach  will  provide  a  new  and 
important  means  of  annunciating  WMD  and  pathogens  in  air  and  water,  for  point-of-interest  and  wide-area  surveillance, 
military  operations,  protection  of  public  sites  and  embassies,  and  other  situations  in  domestic  and  foreign  locations  and  of 
offering  timely  notification  and  treatment  of  affected  individuals;  evaluation  and  response  by  the  Chain  of  Command  ( i.e ., 
public  health,  military);  and,  development  of  new  countermeasures.  Biological  agents  used  as  offensive  weapons  in 
conventional,  unconventional  and  terroristic  warfare  -  and  those  (re)emerging  despite  previous  public  health  control  efforts  - 
know  no  boundaries,  nationalities,  political  or  religious  preferences,  et  cetera  -  they  are  equal  opportunity  threats  to  which 
we  are  all  vulnerable;  we  must  be  prepared. 

The  False  Contact  Environment  in  Littoral  Waters 


Keith  M.  Sullivan 

Naval  Undersea  Warfare  Center  Division  Newport 
Undersea  Warfare  Analysis  Department,  Code  60 
Bldg  1320, 5th  Floor 
1 176  Howell  Street,  Newport,  RI  02841 
(401)  832-4727  (fax  (401)  832-7440) 
sullivankml  @npt. nuwc.navy.mil 


Ralph  S.  Klingbeil 

Naval  Undersea  Warfare  Center  Division  Newport 
Undersea  Warfare  Analysis  Department,  Code  60 
Bldg  1320,  S'*1  Floor 
1 176  Howell  Street,  Newport,  RI  02841 
(401)  832-1336  (fax  (401)  832-7440) 
klingbeilrs@npt.nuwc.naw.mil 


In  future  conflicts,  forward  Naval  power  will  be  required  for  battle-space  preparation  and  timely  crisis  response  against 
anti-access  and  area-denial  forces  in  littoral  waters.  These  waters  are  often  crowded  with  air,  surface,  and  sub-surface  objects 
that  can  lead  to  false  contacts  in  all  sensor  systems.  False  contacts  can  severely  degrade  the  performance  and  effectiveness  of 
military  search,  localization,  and  prosecution  systems.  For  example,  reactive  forces  may  be  employed,  and  weapons 
expended,  unnecessarily  and  detection  and  prosecution  of  real  targets  can  be  delayed  or  missed.  The  false  contact  problem 
can  be  asymmetric  in  that  it  helps  real  targets  hide  but  it  hinders  searchers.  Further  compounding  the  problem  is  that  threat 
signatures,  sensors,  and  weapons  are  improving. 

After  examining  the  general  false  contact  problem,  this  paper  explores  the  nature  of  false  contacts  in  the  littoral  anti¬ 
submarine  warfare  (ASW)  environment.  Operations  research  models,  data,  and  results  are  discussed  which:  (1)  demonstrate 
how  false  contacts  can  deleteriously  affect  system  performance  and  effectiveness  and  (2)  can  be  used  to  derive  tactical  and 
technological  methods  for  the  operational  improvement  of  ASW. 


The  False  Contact  Environment  in  Littoral  Waters 
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Trends  for  Objective  Force  Concept  Development 

Louis  G.  Bornman,  Jr. 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Fort  Leavenworth,  KS  66027-2345 
913-684-9168;  fax  9189 
bornmanl@trac.armv.mil 

This  presentation  presents  the  findings  of  a  review  of  selected  studies  and  analyses  of  potential  future  force  concepts  that 
have  been  used  by  the  U.S.  Army  Training  and  Doctrine  Command  (TRADOC)  in  the  early  development  of  Objective  Force 
concepts.  The  report  derives  important  and  consistent  trends  from  the  source  studies,  and  establishes  a  linkage  between 
these  trends  and  elements  of  the  current  Objective  Force  Operational  and  Organizational  (O&O)  Concept,  Joint  Vision  2020 
and  the  Army  Vision.  This  effort  supports  further  development  of  the  Objective  Force  O&O  Concept  by  establishing  a  basis 
for  core  concepts  and  characteristics. 

Search  &  Destroy  ...  then  Rebuild  Quickly! 

Michael  A.  Bressler 

1660  Jeb  Stuart  Road 
Ft.  Bliss,  Texas  79916-6816 
915-568-2185;  fax  2184 
bresslermichael@otc.armv.mil 

"Becoming  more  efficient  is  the  third  major  challenge  confronting  America's  Army.  By  becoming  efficient,  the  Army 
intends  to  gamer  savings  to  help  ensure  it  can  maintain  a  force  structure  commensurate  with  operational  commitments...  By 
taking  advantage  of  technological  advances,  streamlining  our  processes,  and  reorganizing  our  institutions  the  Army  can  gain 
significant  savings  and  improve  effectiveness  and  efficiency...”  -  Secretary  of  the  Army  from  his  Statement  to  Congress 
on  the  Posture  of  the  United  States  Army  for  FY97  (Chapter  4) 

The  Army's  commitment  to  achieving  efficiency  during  peacetime  by  exploring  (and  using)  technical  innovation  may 
now  have  a  wartime  spin-off  advantage  as  America  engages  a  world-wide  war  against  terror  for  an  undetermined  period  of 
time.  Usually  the  opposite  is  true,  wartime  pressures  on  industry  to  develop  more  lethal  war  components  tend  to  generate 
post-war  improvements  for  society  in  general.  Now  that  the  great  war  against  terror  is  on,  a  sounder,  more  efficient  procedure 
needs  to  be  considered  for  post-combat  reconstruction  as  a  means  to  maintain  the  momentum  in  counter-terrorist  operations. 
In  this  war  its  not  enough  to  kill  the  enemy  quickly  through  instant  and  overwhelming  means  only  to  be  haunted  later  by 
collateral  devastation  to  an  innocent  general  population.  This  mistake  invites  a  resurgence  of  sympathy  for  the  defeated 
regime  or  at  a  minimum  sharpens  an  excuse  for  hatred  against  America  which  other  foreign  enemies  are  only  too  happy  to 
contrive. 

How  to  blunt  this  possibility  by  devising  a  rapid  deployment  for  reconstruction  will  be  the  theme  of  this  paper. 

This  paper  is  about  an  aspect  of  military  thinking  that  needs  up-dating,  a  modification  to  the  notion  that  complete  enemy 
devastation  will  guarantee  the  destruction  of  terrorism.  In  some  instances  this  paper  will  offer  revolutionary,  bold,  new  and 
creative  vision  that  pushes  the  envelope  on  achieving  results  through  the  rapid  application  of  innovation.  Then  suggest 
making  it  a  part  of  the  standard  military  operation  against  terrorists.  American  ingenuity  is  the  most  valuable  intellectual 
asset  our  Country  possesses,  yet  its  management  (at  times)  has  been  allowed  to  stagnate. 

The  paper  has  two  parts:  first,  a  discussion  on  two  example  innovations  and  their  economic  possibility  for  the  peace¬ 
time  Army;  the  second  part  of  the  paper  is  about  the  transitioning  of  these  examples  to  a  meaningful  and  immediate,  post¬ 
combat  application  using  the  war  in  Afghanistan  as  an  example. 
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Land  C2  in  a  Supply  and  Transportation  Constrained  Environment  in  JWARS 
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Arlington,  VA  22209 
pbross@caci.com 


Chuck  Burdick 
JWARS  (Lockheed  Martin) 
1555  Wilson  Blvd.  (Suite  620) 
Arlington,  VA  22209 
chuck.burdick@lmco.com 


LTC  Harry  Argo 
JWARS 

1555  Wilson  Blvd.  (Suite  620) 
Arlington,  VA  22209 
harrv.argo@osd.pentagon.mil 


The  JWARS  Land  forces  are  represented  at  a  level  of  detail  and  a  breadth  that  has  not  been  attempted  before  in  long 
running,  Theater-level  models.  This  has  meant  a  much  larger  number  of  ground  units  to  command  and  control  over  a  much 
longer  time  period  and,  consequently,  more  concerns  to  be  addressed  than  in  past  theater  models.  This  presentation  focuses 
on  the  Land  Commander  and  Supply  Planner  represented  in  JWARS  and  describes  the  symbiotic  relationship  that  exists 
between  them.  The  Supply  Planner  (G4)  basis  his  requests  on  his  subordinate’s  current  needs  and  the  expected  operations 
described  in  the  Land  Plan,  while  the  Land  Commander’s  plan  is,  itself,  constrained  by  the  ability  of  the  supply  and 
transportation  system  to  provide  the  needed  Classes  of  supply.  Specifically,  the  presentation  addresses  the  JWARS: 
Commander’s  Model  (Situation  Assessment,  Course  of  Action  (CO A)  Selection,  and  Guidance) 

The  role  of  supply  in  the  Commander’s  Wargame 

The  Transportation  and  Logistics  system  (TPFDD  integration  and  intra-Theater  resupply) 

Land  Supply  Planner  (supply  projection,  local  resupply,  and  local  transportation) 

Prioritization  of  supplies  on  a  perception  based  battlefield 


Particular  emphasis  will  be  placed  on  the  difficulties  of  projecting  operations  and  transporting  supplies  in  a  two-sided 
engagement,  where  each  force  recognizes  that  running  out  of  munitions  or  fuel  by  either  side  equals  its  defeat  and  takes  that 
into  consideration  when  building  his  war  plan.  This  presentation  provides  sanitized  examples  of  COA  selection  by  the 
Commander’s  Wargame  algorithm,  demonstrates  the  impact  of  supply  consumption  and  resupply  capability  on  that  selection, 
and  shows  the  discrepancies  that  can  occur  between  the  plan  and  the  running  of  the  simulation  itself. 


Objective  Force  Concept  Exploration ,  A  Notional  Combat  Battalion  Engagement 

MAJ  Paul  J.  Finken 

TRADOC  Analysis  Center 

255  Sedgwick  Ave.,  Ft.  Leavenworth,  KS  66027 

913-684-9169;  fax  9189,  fmkenp@trac.armv.mil 

This  study  supports  Objective  Force  Combat  Battalion  concept  development  and  the  Army  Transformation.  It  focused 
on  developing,  examining,  and  refining  Combat  Battalion  concepts,  and  supporting  the  Future  Combat  System  (FCS) 
Mission  Needs  Analysis. 

The  study  scenario  facilitates  analysis  of  the  Objective  Force  in  combat  operations.  The  scenario  provides  a  context  in 
which  an  Objective  Force  Combat  Battalion  conducts  offensive  operations  in  2015  against  a  technologically  advanced  Red 
force.  The  engagement  was  explicitly  modeled  using  the  Interactive  Distributed  Engineering  Evaluation  and  Analysis 
Simulation  (IDEEAS)  model.  IDEEAS  is  an  entity-based  simulation,  capable  of  force-on-force  representations,  that  permits 
examination  of  concepts  and  parametric  analysis  at  the  engineering  level  of  detail.  Use  of  the  notional  battalion  force 
structure  allowed  O&O  concept  exploration  prior  to  force  design  decisions. 

This  study  contributed  substantially  to  the  development  of  the  Objective  Force,  especially  with  regard  to  the  Unit  of 
Action  force  design.  In  addition  to  the  development  of  concepts,  tactics,  and  insights  for  future  operations  the  study  provided 
a  powerful  visualization  of  this  future  force.  The  scenario  and  base  case  developed  during  this  study  were  used  extensively 
by  the  TRADOC  Unit  of  Action  Task  Force  in  their  subsequent  refinement  of  the  force  design.  These  tools  were  also  used 
by  the  Army  Medical  Department  in  its  transformation  wargame  effort. 

This  presentation  will  provide  an  overview  of  the  study  scenario’s  purpose,  methodology  and  results. 


Wargaming  to  Support  Objective  Force  Concept  Development 

Rochelle  A.  Hill 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 
913-684-9320;  fax  9189,  hillr@trac.armv.mil 

The  Objective  Force  is  the  realization  of  the  Army  vision  that  was  presented  by  the  Chief  of  Staff  of  the  Army  (CSA)  in 
October  1999.  The  transformation  from  vision  to  fielded  Objective  Force  is  a  process  that  will  occur  over  several  decades. 
An  early  and  critically  important  piece  of  this  process  is  the  development  of  Operational  and  Organizational  (O&O) 
Concepts.  These  Objective  Force  O&O  concepts  are  grounded  in  the  futures  work  that  was  done  as  part  of  the  Army  After 
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Next  (AAN)  project.  Futures  wargaming  has  evolved  to  become  an  important  part  in  the  development  of  these  concepts.  In 
particular,  the  annual  Army  Transformation  Wargame  (ATWG)  has  emerged  as  the  Army’s  most  visible  event  for  future 
concept  development. 

The  TRADOC  Analysis  Center  (TRAC)  serves  as  the  lead  analytic  agency  for  the  ATWG  sponsored  by  the  TRADOC 
Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  This  series  of  wargames  is  designed  to  describe,  refine  and  evaluate 
Objective  Force  concepts  and  capabilities  over  a  multi-year  period.  These  wargames  provide  the  Army  an  opportunity  to 
explore  future  Army  operations  at  the  strategic  and  operational  levels  of  war  in  a  political/military  wargame  environment. 

This  presentation  will  address  the  analytic  support  provided  to  ATWG  01,  Vigilant  Warriors.  In  particular,  it  will 
provide  an  overview  of  the  wargame  to  include  analysis  and  reporting  of  the  insights  for  the  issues  addressed. 

Common  Missile  Range  Requirements  Analysis 

CPT  John  Hollowell 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Fort  Leavenworth,  KS  66027 
913-684-9198;  fax  9191 
hollowelli  @  trac.armv.mil 

Current  TOW  and  Hellfire  missile  families  will  not  adequately  address  emerging  threats/capabilities  of  advanced  armor 
protection,  active  protective  systems  (APS),  and  defensive  aid  suites  nor  provide  sufficient  standoff  to  counter  the  increased 
range  of  emerging  threat  air  defense  and  anti-tank  guided  missiles.  The  US  Army  Training  and  Doctrine  Command 
(TRADOC)  Analysis  Center  (TRAC)  performed  the  Common  Missile  Range  Requirements  Analysis  as  part  of  an  overall 
analytic  effort  supporting  acquisition  of  the  Common  Missile  (CM).  This  range  requirements  study  develops  additional 
analytical  rationale  for  Key  Performance  Parameters  (KPP)  published  in  the  draft  CM  Operational  Requirements  Document 
(ORD).  This  study  evaluates  the  impact  of  CM  range  on  the  operational  effectiveness  of  Army  and  Marine  Corps  ground  and 
aviation  forces  at  the  Corps  and  Division  level.  This  study  compared  two  missile  range  alternatives  (both  12-km  and  16-km 
ground  and  aviation  missiles)  against  a  base  case  using  current  TOW  and  Longbow  Hellfire  missile  ranges.  Study 
methodology  included  combat  simulation  of  the  base  case  and  alternative  force  capabilities,  in  the  context  of  two  major 
theater  war  scenarios,  using  the  Vector-In-Commander  (VIC)  model. 

TRACER/FSCS  Combined  Analysis 

William  J.  Krondak 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Fort  Leavenworth  KS  66027 
913-684-9188;  fax  9191 
krondak  w  @  trac .  army .  mi  1 

During  the  last  two  years,  a  combined  UK/US  operational  analysis  working  group  conducted  the  Tactical 
Reconnaissance  Armoured  Combat  Equipment  Requirement  (TRACER)/Future  Scout  Cavalry  System  (FSCS)  analysis 
leading  up  to  the  February  2001  Affordability  Review  held  in  London.  This  presentation  will  show  the  study  approach, 
highlight  the  initiatives  in  new  Measures  of  Performance  (MOP)  and  Measures  of  Effectiveness  (MOE)  used  by  the  two 
countries,  note  the  challenges  and  successes  of  a  combined  analysis  and  present  the  analysis  results.  Included  in  the 
presentation  will  be: 

A  brief  review  of  the  methods  and  tools  used  in  the  analysis,  including  the  MOE  and  MOP,  the  models,  and 
scenarios. 

The  technical  analysis  and  system  performance  approach  and  results. 

The  operational  effectiveness  analysis  results,  highlighting  the  effects  of  innovative  approaches  to  representing 
ground  scout  capabilities  in  combat  models,  and  the  insights  gained  from  the  work. 

The  combined  cost  analysis  approach  and  results. 

General  conclusions  and  recommendations. 

Lessons  learned  regarding  MOE  and  MOP  that  may  apply  to  Future  Combat  System  and  Objective  Force  analysis. 
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Interim  Division  Design  Analysis:  Lessons  Learned  for  Objective  Force  Analysis 

MAJ  Lisa  J.  Lamb 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027-2345 
913-684-9194;  fax  9189,  lambl@trac.armv.mil 

This  paper  focuses  on  the  lessons  learned  from  Interim  Division  Design  Analysis  and  how  they  relate  to  upcoming 
Objective  Force  analyses.  In  February  2000,  the  U.S.  Army  Training  and  Doctrine  Command  (TRADOC)  began 
investigating  various  appropriate  parent  organizations  in  which  to  place  the  five  to  eight  Interim  Brigade  Combat  Teams 
(IBCT)  that  the  Army  envisioned  fielding  as  part  of  Army  Transformation.  Over  the  past  two  years,  the  ideas  and  concepts 
that  TRADOC  explored  led  to  a  division  structure  that  was  built  on  three  IBCT-like  organizations.  This  division  formed  the 
basis  of  TRADOC ’s  IDIV  development  effort.  The  concepts  were  investigated  using  a  variety  of  analytic  tools  and  included 
a  comparison  of  the  IDIV’s  deployability,  sustainability,  lethality,  survivability,  agility,  versatility,  and  overall  strategic 
responsiveness  to  that  of  a  Limited  Conversion  Division  with  an  embedded  IBCT  and  a  Light  Infantry  Division. 

The  Interim  Division  Design  Analysis  required  innovative  thinking  and  development  of  new  methodologies  to  address 
interim  force  design  issues.  This  paper  will  address  the  methodologies  developed  and  how  they  relate  to  the  Objective  Force 
analyses. 

Common  Missile  Requirements  Analysis 

David  A.  Loental 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth  66027-2345 

913-684-9160;  fax  9191,  loentald@trac.armv.mil 

In  response  to  a  U.S.  Army  Headquarters,  Training  and  Doctrine  Command  (TRADOC)  tasking,  the  TRADOC  Analysis 
Center  at  Fort  Leavenworth  (TRAC-FLVN)  led  an  analysis  of  Common  Missile  requirements.  The  purpose  of  this  study  was 
to  underpin  development  of  the  Common  Missile  Operational  Requirements  Document,  help  guide  contractor  efforts  to 
develop  Common  Missile  design  alternatives,  and  help  identify  areas  for  further  investigation  in  a  subsequent  Analysis  of 
Alternatives. 

The  objective  of  the  Common  Missile  acquisition  program  is  to  field  a  single  missile  to  replace  the  TOW  and  Hellfire 
missile  families  and  possibly,  to  field  a  missile  variant  for  fixed  wing  platforms. 

Primary  study  team  organizations  included  TRAC-FLVN,  TRAC-White  Sands  Missile  Range,  TRAC-Fort  Lee,  Program 
Executive  Office-Tactical  Missiles,  and  the  Threat  Support  Directorate  in  the  Headquarters  TRADOC  Deputy  Chief  of  Staff 
for  Intelligence.  Important  supporting  contributions  came  from  the  following  U.S.  Army  organizations:  Army  Materiel 
Systems  Analysis  Activity,  Aviation  and  Missile  Research,  Development,  and  Engineering  Center,  TRADOC  Systems 
Manager  (TSM)-Longbow  Apache,  TSM-Comanche,  TSM-Close  Support  Missile  Systems,  and  the  Infantry,  Aviation,  and 
Armor  Schools. 

The  paper  provides  an  overview  of  the  analysis  methodology  used,  scenarios  employed,  and  study  alternatives.  It  also 
presents  important  findings  and  conclusions  regarding  required  missile  range,  lethality,  and  “fire  and  forget”  and  “man-in- 
the-loop”  missile  engagement  modes. 

Objective  Force  Risk  Analysis 

Steven  L.  Moniz 

TRADOC  Analysis  Center 

255  Sedgwick  Avenue,  Fort  Leavenworth,  KS  66027-2345 
913-684-9146;  fax  9189,  monizs@trac.armv.mil 

In  the  early  1990’s  the  Army  set  the  goal  of  applying  risk  management  principles  to  all  of  its  projects  and  processes. 
TRAC  has  begun  a  risk  management  analysis  of  the  Army’s  transition  to  the  future  Objective  Force.  This  analysis  supports 
the  development  of  Objective  Force  concepts  by  identifying  the  hazards  most  dangerous  to  future  operations  and  most 
relevant  to  the  transition  process. 

The  presentation  will  cover,  in  addition  to  the  results,  the  challenges  of  identifying  the  hazards,  collecting  the  data  (via  a 
survey),  and  analyzing  the  data. 
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Historical  Analysis  of  SSC  Operations 

Herman  J.  Orqeron 

Center  for  Army  Analysis 
6001  Goethals  Road 
Fort  Belvoir,  VA  22060-5230 
703-806-5682;  fax  5750 
orgeron@caa.army.mil 

CAA  performed  the  initial  work,  called  the  Stochastic  Analysis  of  Resources  for  Deployments  and  Excursions 
(SARDE),  under  the  sponsorship  of  the  War  Plans  Division  of  the  Office  of  the  Deputy  Chief  of  Staff  for  Operations  and 
Plans  (ODCSOPS).  SARDE’s  objectives  include  the  development  and  demonstration  of  a  methodology  to  predict  the 
requirement  for  Army  units,  by  type,  needed  to  support  simultaneous  smaller  scale  contingency  operations  (SSCs)  in  the 
future.  In  October  2000,  the  Operations  Directorate  of  ODCSOPS  requested  an  update  using  historical  data  to  the  greatest 
extent  possible.  The  work  also  needed  to  use  any  updates  to  the  methodology.  This  study,  called  Historical  Analysis  of 
SSC  Operations  2000  (HASO  2000),  was  completed  in  2000,  revised  and  updated  in  2001,  and  provided  to  staff  agencies  in 
ODCSOPS  for  use  in  their  overall  force  structure  requirements  analysis. 

Information  Exchange  Requirements  (IERs)  Development  in  Support  of  the  Army  Transformation 

Stephen  M.  Orloff 

The  Johns  Hopkins  University  Applied  Physics  Laboratory 
1 1000  Johns  Hopkins  Rd.,  Laurel,  MD  20723-6099 
443-778-3890;  fax:  5272 
Stephen.Orloff@jhuapl.edu 

The  Applied  Physics  Laboratory  of  Johns  Hopkins  University  (APL),  in  support  of  Army  Transformation,  conducted  a 
“Future  Combat  Systems  (FCS)  Network-Centric  Concepts  and  Operations”  study.  The  purpose  of  the  study  is  to  develop  a 
candidate  architecture  that  facilitates  network-centric  operations.  This  two  phase  study  was  sponsored  by  the  Office  of  the 
Deputy  Assistant  Secretary  for  Research  and  Technology,  Assistant  Secretary  of  the  Army  for  Acquisition,  Logistics,  and 
Technology  [ASA(ALT)]. 

Phase  I  developed  a  qualitative  identification  of  candidate  FCS  force  network  architectures  and  their  associated  primary 
tasks  and  information  exchange  requirements  (IER).  Phase  II  consisted  of  detailed  technical  assessments  of  candidate 
architectures  to  quantify  network  requirements  and  propose  a  recommended  architecture  that  enables  FCS  network-centric 
operations  at  force  level  echelons.  The  development  of  an  Objective  Force  (OF)  environment  and  IERs  was  a  key  step  in  the 
study  process.  The  development  of  the  Objective  Force  environment  was  conditioned  by  an  emerging  set  of  Objective  Force 
Operations  and  Organizational  Concepts  (O&O),  FCS  acquisition  documents,  and  ongoing  FCS  studies  and  experiments. 
The  study  methodology  is  characterized  by  its  flexibility  and  adaptability  to  a  maturing  O&O.  The  IERs  were  developed 
within  the  context  of  the  OF  environment  and  represent  a  class  of  tasks,  message  content,  and  network  capacity  requirements 
that  are  sufficiently  detailed  so  as  to  support  the  development  of  traffic  modeling  across  a  set  of  candidate  network 
architectures. 

This  presentation  will  describe  the  development  of  an  Objective  Force  environment,  its  associated  information  exchange 
requirements,  the  implications  of  traffic  modeling,  and  the  development  of  a  candidate  network  architecture  that  enables 
network-centric  operations. 

Global  War  on  Terrorism  (GWOT)  Special  Project  (SP) 

MAJ  Karl  O.  Schwartz 

Center  for  Army  Analysis 

6001  Goethals  Road 

Fort  Belvoir,  VA  22060 

703-806-5611;  fax  5727,  Schwartz@caa.armvmil 


The  Global  War  on  Terrorism  (GWOT)  has  taken  center  stage  in  much  of  the  joint  planning  on  higher  staffs  and  many  of 
our  minds.  The  presentation  focuses  on  one  specific  operation.  This  operation  centers  on  modifying  a  current  scenario  with 
limited  objectives  and  a  constrained  available  force.  The  purpose  is  to  evaluate  varying  cases  in  a  joint  environment  on  the 
basis  of  achieving  the  objectives  and  the  risk  associated  with  each  case. 
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Collateral  Damage  Study 


Karen  Sias 

AMSAA 

392  Hopkins  Road 
APG,  MD  21005 
410-278-6971;  fax  6632 
sias@amsaa.army.mil 


William  Clay 
AMSAA 

392  Hopkins  Road 
APG,  MD  21005 
410-278-6885;  fax  6632 
wpclay@amsaa.armv.mil 


The  U.S.  Army  Materiel  Systems  Analysis  Activity  (AMSAA)  developed  a  Collateral  Damage  Study  Plan  to  support 
both  the  XM982  Excalibur  and  Precision  Guided  Mortar  Munition  (PGMM)  Analyses  of  Alternatives  (AoA’s),  as  well  as  to 
provide  the  Army  with  a  current  assessment  of  collateral  damage  potential  for  current  an  emerging  munitions. 

The  purpose  of  the  Collateral  Damage  Study  is  to  compare  the  effectiveness  and  collateral  damage  potential  for  a  variety 
of  indirect  munitions  versus  tactical  targets  in  urbanized  areas.  The  measures  of  collateral  damage  will  include  damage  to 
buildings,  civilian  vehicles  and  civilians  on  the  streets.  The  three  measures  will  be  integrated  to  a  single  measure  of  collateral 
damage  relative  to  civilians  receiving  a  serious  wound  to  facilitate  comparisons  between  the  munitions. 

To  conduct  the  Collateral  Damage  Study,  seven  terrain  templates  have  been  developed  to  represent  typical  urbanized 
areas  that  one  might  find  globally.  These  templates  were  based  largely  on  the  in-depth  work  of  Dr.  Richard  Ellefsen.  For  the 
study,  each  target  will  be  placed  in  particular  locations  on  one  of  the  urban  templates.  The  damage  to  the  tactical  targets, 
civilian  vehicles,  and  to  civilians  on  the  streets  will  be  measured  using  standard  AMSAA  Effectiveness  models;  i.e. 
Simplified  Artillery  Projectile  Effectiveness  Model  (ARTQUIK),  and  Support  Warfare  Mean  Area  of  Effects  (SWAMAE) 
model.  The  ARTQUIK  model  calculates  the  effects  of  conventional  artillery  firing  high  explosives  or  improved  conventional 
munitions  against  homogeneous  targets.  The  SWAMAE  model  generates  the  component-level  and  whole-vehicle  mean  area 
of  effects  which  are  used  in  effectiveness  programs  such  as  ARTQUIK.  Additionally,  the  Modular  Effectiveness 
Vulnerability  Assessments  (MEVA)  Military  Operations  in  Urban  Terrain  (MOUT)  model,  will  be  used  to  evaluate  the 
damage  to  buildings. 


C3  Test  Driver  Scenario  Development 


Mr.  Paul  W.  Works,  Jr. 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth  66027-2345 
913-684-9160;  fax  9191 
wor  ksp  @  trac .  army  .mil 


CPT  Steven  Cram 
TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 
913-684-9221;  fax  9191 
crams@trac.armv.mil 


The  Command,  Control,  and  Communications  Test  Driver  program  was  initiated  in  response  to  a  Deputy  Undersecretary 
of  the  Army  for  Operations  Research  (DUSA-OR)  tasking.  The  US  Army  Test  and  Evaluation  Command  (ATEC),  the  US 
Army  Simulation,  Training  and  Instrumentation  Command  (STRICOM),  and  the  US  Army  Electronic  Proving  Ground  (EPG) 
lead  the  C3  Test  Driver  Program.  The  Program  involves  key  participants  within  the  TRADOC  Analysis  Center  (TRAC),  the 
Central  Technical  Support  Facility  (CTSF),  the  US  Army  Operational  Test  Command  (OTC),  and  the  TRADOC  Threat 
Support  Directorate  (TSD). 

The  objective  is  to  support  developmental,  integration,  and  operational  testing  of  Army  Battle  Command  System 
(ABCS)  components  using  standard  models,  standard  mission/message  threads,  and  standard  scenarios. 

The  scenario  development  effort  was  tasked  in  Phase  I  of  the  C3  Test  Driver  Program  (FY01)  to  produce  an  unclassified, 
brigade-level  scenario  to  be  used  as  the  background  for  C3  Test  Driver  message  generation  and  traffic.  This  scenario  was 
located  on  the  National  Training  Center  and  featured  a  Force  XXI  brigade  against  an  opposing  gorces  division.  Key  events 
were  identified  within  a  scripted  time-ordered  event-list  to  initiate  various  mission/message  threads.  C3  Test  Driver  uses  this 
message  traffic  to  stimulate  real  systems  under  test,  evaluate  their  performance,  and  facilitate  developmental  and  integration 
testing. 


Classified  corps-division  and  brigade-level  scenarios  are  being  developed  for  use  in  Phases  II  and  III  of  this  program. 
These  scenarios,  and  vignettes  identified  within  them,  will  use  a  dynamic  simulation  and  a  robust  set  of  doctrinal 
mission/message  threads  to  additionally  support  operational  testing  and  training. 
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JWARS:  Littoral  Warfare 

CDR  Boots  Barnes,  USN 

OSD  PA&E,  JWARS  Office 

1555  Wilson  Blvd,  Suite  620,  Rosslyn,  VA  22209 

(703)-696-9490  FAX  (703)-696-9563 

barness@osd.pentagon.mil 

The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  constructive  simulation  that  shall  provide  a  multi-sided 
and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  CINCs,  Joint  Task  Force  (JTF) 
Commanders/Staff,  Services,  Joint  Staff,  Office  of  the  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS 
will  be  capable  of  performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  IOC,  and  will  be  able  to  perform  System 
Effectiveness  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  FOC. 

This  presentation  will  provide  insight  into  the  Maritime  warfighting  functionality  that  has  been  designed  into  the 
JWARS  simulation  to  date.  Discussion  will  center  around  Maritime  C4ISR,  Surface  Warfare,  Mine  Warfare,  Naval  Surface 
Fire  Support,  Undersea  Warfare,  Undersea  Warfare,  Naval  Blockade,  Aegis  TBMD  and  Forcible  Entry  (Amphibious 
Warfare).  A  Screen  Cam  image  of  the  simulation  will  be  available  at  MORSS  and  will  provide  a  point  of  discussion  where 
appropriate.  The  Joint  Analytic  Model  Improvement  Program  (JAMIP)  is  the  proponent  of  the  JWARS  model.  The 
associated  JAMIP  Executive  Committee  (EXCOM)  and  Steering  Committee  (SC)  are  the  associated  approval  authorities  for 
the  JWARS  program.  This  presentation  will  discuss  the  importance  of  Joint  warfare  and  its  relationship  to  Maritime 
capabilities  along  with  JAMIP  oversight  to  the  program. 

Strategic  Anti-Missile  Attrition  Zone  (SAAZ)  Defense 

Michael  Bressler 

Air  Defense  Artillery  Directorate 
1660  Jeb  Stuart  Road 
Ft.  Bliss  TX,  79916 

(915-568-2185,  bresslermichael@otc.armv.mil 

The  paper  presented  in  this  presentation  will  do  away  with  conventional  thinking  and  structure  a  practical  approach  to 
the  quagmire  of  uncertainties  associated  with  a  national  missile  defense.  It  will  key  into  the  Defense  Secretary's  desire  to 
explore  new  approaches,  think  beyond  the  conventional,  and  attempt  "out-of-the-box"  vision.  It  will  advance  a  notion  of 
shared  cost-shared  responsibility  among  all  the  Armed  Services  making  use  of  all  the  good  and  valuable  work  heretofore 
accomplished  by  an  unprecedented  Govemment/Contractor  effort.  The  paper  is  an  attempt  to  kick-start  thinking  and  provoke 
questions  in  response  tot  he  Secretary's  2  January  "guidance"  memorandum  that  clearly  challenges  us  all  to  revitalize  our 
thinking. 

The  paper  concludes  with  a  hypothetical  war  scenario  taking  place  in  the  year  2025,  which  call  into  play  a  smooth 
working  relationship  of  all  the  Service  including  the  US  Coast  Guard. 

Search  Theory >  Invented  Now 

Jeffrey  R.  Cares 

President,  Alidade  Consulting 
31  Willow  Street,  Newport,  RI  02840 
(401)935-9961,  FAX  (425)871-5466,  ieff@alidade.net 

Search  Theory  was  developed  when  operators  and  academics  collaborated  to  apply  mathematics  to  a  very  tangible  task: 
to  find  a  militarily  important  object  in  the  quickest,  best  way  possible.  Early  Search  Theory  successes  contributed  to  the 
foundations  of  a  new  discipline,  Operations  Research.  This  field  now  consists  of  two  types  of  professionals,  analysts  who 
work  directly  with  operators  to  solve  pressing  operational  problems  and  academics  who  work  to  develop  new  mathematical 
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results.  Within  the  topic  of  Search  Theory,  however,  these  two  groups  have  increasingly  diverged  since  their  early  practical 
successes.  While  the  Operations  Research  Analysts  continue  to  ply  their  trade  with  a  toolbox  of  practical  techniques  among 
tactically  minded  decision  makers,  the  academics  have  gravitated  to  interesting  but  extraordinarily  abstract  results  in  complex 
multivariate  mathematics.  A  major  research  topic  of  much  recent  work  in  operations  research  has  been  the  development  of 
effective  search  algorithms  for  finding  good  solutions  to  very  complex  optimization  problems. 

A  third  claimant  to  search  solutions  is  now  emerging:  almost  every  advanced  warfare  concept  depends  on  high- 
performance  collective  robotics,  most  notably  for  search  and  surveillance  operations.  This  raises  an  intriguing  proposition: 
might  arranging  the  instruments  of  a  search  (collective  autonomous  agents)  require  the  same  complex  optimization  solutions 
as  the  process  of  the  search  (finding  the  target)?  If  so,  we  are  on  the  verge  of  a  new,  ironic  definition  of  Search  Theory.  More 
importantly,  it  appears  that  the  fundamental  precepts  of  Koopman-style  Search  Theory  might  warrant  reconsideration.  This 
presentation  reports  on  a  recent  workshop  in  which  the  conferees  discussed  the  question,  “What  would  Search  Theory  look 
like  if  it  were  invented  now?” 

Major  Theater  War  -  Western  Pacific  (MTW  West? AC)  Joint  Campaign  Analysis 
Evan  Farris 

SPA,  200  North  Beauregard,  Ste.  400 
Alexandria  VA  22311 

(703)578-5667,  FAX  (703)578-5688,  efarris@spa-inc.com 

This  presentation  will  introduce  a  new  planning  scenario  and  joint  campaign  analysis  for  a  major  conflict  in  the  Western 
Pacific  (MTW  WestPAC).  This  scenario  postulates  the  naval  blockade  of  a  nation  friendly  to  the  United  States  and  explores 
the  options  available  for  a  joint  response.  The  MTW-WestPAC  scenario  was  originally  developed  by  OPNAV  N81  and  has 
since  been  used  in  the  Quadrennial  Defense  Review  and  the  Navy  planning  process.  This  presentation  will  include  an 
overview  of  the  scenario  including  the  major  options  for  joint  operations  in  response  to  the  threat,  an  overview  of  the  analytic 
approach  taken  and  tools  used  to  develop  the  assessment  baseline  for  the  scenario,  and  a  summary  of  the  assessment  baseline 
results  and  excursion  analyses  identified. 

System-level  Analysis  of  Sea-based  Missile  Defense  Using  High  Fidelity  Monte  Carlo  Simulation 

Peter  Fortman 

Lockheed  Martin  -  NE&SS 

199  Borton  Landing  Road  Mail  Stop  13000-1 A 

Morrestown  NJ 

(856)638-7053  (Phone)  (856)638-4304  (Fax) 
peter.a.fortman@lmco.com 

Approved  abstract  unavailable  at  printing. 

Defending  the  Sea  Lance 
John  M.  Green 

University  of  California,  San  Diego 
16346  Santa  Cristobal  St. 

San  Diego,  CA  92127 

(858)  673  0856  (Phone)  (858)  673  0119  (Fax) 
imgreen@san.rr.com 

As  the  Navy  transforms  itself  into  a  littoral  fighting  force  it  is  becoming  clearer  that  a  centerpiece  of  the  change  may  be  a 
new  class  of  smaller,  stealthier,  and  faster  ships.  These  “Streetfighters”  will  be  characterized  by  small  crews,  smaller  sensors, 
and  an  operational  mandate  to  operate  much  closer  inshore  of  the  dangerous  waters  of  our  nation’s  foes.  These  smaller 
platforms  will  be  at  greater  risk  because  of  their  postulated  sensor-weapons  mix.  For  example,  the  High  Speed  Vessel  (HSV) 
would  be  equipped  with  CEC  and  Sea  Ram.  This  limited  capability  gives  rise  to  the  concern  that  lessons  learned  such  as  the 
USS  Stark  may  be  receding  into  the  dim  past. 

This  paper  asserts  that  the  layered  defense  concept  applies  at  the  ship  or  node  level  as  well  as  the  Battle  Force  level. 
These  platforms  may  be  required  to  operate  at  the  edge  of  the  defensive  umbrella.  The  defensive  capabilities  of  these  smaller 
ships  must  be  able  to  address  the  shortened  engagement  timelines  created  by  proximity  to  land.  The  most  viable  approach  to 
self-defense  is  a  layering  of  active  and  passive  weapons  assets  focused  on  disrupting  the  threat  kill  chain.  In  addition,  the 
small  crews  envisioned  require  an  innovative  approach  to  how  these  weapons  will  be  served.  The  paper  will  summarize  the 
key  issues  in  developing  a  layered  defense  at  the  platform  level  and  present  a  notional  concept  for  defending  the  Sea  Lance. 


Bonnie  Worth  Johnson 
Digital  System  Resources,  Inc 
2341  Jefferson  Davis  Hwy,  Suite  810 
Arlington,  VA  22202 

(703)  298-4577  (Phone)  (703)  418-91 57  (Fax) 
bwiohnson@dsrnet.com 
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Layered  Defense  and  Interoperability  within  the  Navy 


John  M.  Green 

University  of  California,  San  Diego 
16346  Santa  Cristobal  St.,  San  Diego,  CA  92127 
(858)  673  0856  (Phone)  (858)  673  01 19  (Fax) 
imgreen@san.rr.com 


Bonnie  Worth  Johnson 
Digital  System  Resources,  Inc 

2341  Jefferson  Davis  Hwy,  #  810,  Arlington,  VA  22202 
(703)  298-4577  (Phone)  (703)  418-9157  (Fax) 
bwiohnson@dsrnet.com 


A  crucial  issue  to  the  success  of  an  AAW  layered  defense  is  communications  between  and  within  the  layers.  The  Navy  is 
faced  with  a  dilemma  in  developing  a  satisfactory  AAW  layered  defense  because  combat  system  development  has  followed 
two  divergent  paths,  AEGIS  and  SSDS  MK2,  resulting  in  significant  interoperability  problems.  Despite  both  the  ATHENA 
and  the  more  recent  Common  Command  and  Decision  efforts  the  Navy  has  not  developed  a  paradigm  that  merges  the 
concepts  of  area  defense  and  self-defense.  Both  AEGIS  and  SSDS  MK2  continue  development  within  their  own  stovepipes. 

This  paper  contends  that  an  effective  layered  defense  should  be  pursued  from  the  perspective  that  solutions  to 
interoperability  issues  between  and  within  platforms  can  be  developed  from  a  common  architecture  that  supports  network 
centric  warfare.  In  support  of  this  point  of  view,  the  paper  discusses  a  high  level  architecture  that  is  derived  from  relevant 
sources  such  as  Operational  Requirements  Documents  (ORDs)  that  address  layered  defense  and  interoperability  at  the  battle 
force  and  platform  (or  node)  level.  The  AEGIS  and  SSDS  MK2  system  functions  are  mapped  against  this  top-level 
architecture  and  their  contributions  to  layered  defense  are  compared.  The  identified  similarities  and  differences  are 
contrasted  and  a  roadmap  to  a  merger  of  both  systems  is  presented. 

Combined  Forces  Command  Amphibious  Analysis  III 

Brian  Hodges 

Operations  Research  Analyst 

TRADOC  Analysis  Center,  Ft.  Leavenworth,  KS 

(913)  684-9207,  hodgesb@trac.armv.mil 


The  Combined  Forces  Command  Amphibious  Analysis  III  analyzes  a  branch  plan  of  a  Combined  Forces  Command 
Operation  Plan  (OPLAN)  employing  combined  Naval  and  Marine  Forces.  For  this  analysis,  TRAC  employed  its  own  Vector 
in  Commander  amphibious  modeling  capabilities.  TRAC  also  integrated  analytical  efforts  from  a  number  of  joint  service 
agencies  such  as  US  Transportation  Command's  Military  Traffic  Management  Command  Transportation  Engineering 
Agency,  the  Center  for  Naval  Analysis,  Marine  Corps  Combat  Development  Command,  and  the  Navy's  Mine 
Countermeasures  Squadron  One  to  complete  the  effort.  The  presentation  will  highlight  the  amphibious  operations  modeling 
approach,  the  study  methodology,  study  findings,  and  analytical  insights. 

Naval  Network-Centric  Sensor  Resource  Management 

Bonnie  Worth  Johnson  John  M.  Green 

Digital  System  Resources,  Inc  University  of  California,  San  Diego 

2341  Jefferson  Davis  Hwy,  Suite  810  16346  Santa  Cristobal  St. 

Arlington,  VA  22202  San  Diego,  CA  92127 

(703)  298-4577  (Phone)  (703)  418-9157  (Fax)  (858)  673  0856  (Phone)  (858)  673  01 19  (Fax) 

bwiohnson@dsrnet.com  imgreen@san.rr.com 

The  benefits  of  implementing  a  network-centric  Navy  lie  in  the  new  capabilities  made  possible  by  enhanced  information 

sharing  between  Naval  platforms.  Foremost  is  the  potential  to  enable,  enhance,  and  automate  dispersed  decision-making  to 
support  real-time  critical  mission  areas.  This  paper  explores  a  network-centric  paradigm-enabled  application:  multi-platform 
sensor  resource  management. 

Sensors  in  platform-centric  Naval  Battle  Forces  are  generally  utilized  and  managed  to  support  a  single  weapon  or  combat 
system.  The  networking  of  combat  systems  and  platforms  creates  an  information  architecture  in  which  sensor  management 
can  shift  to  a  Battle  Force  (BF)  focus.  In  such  a  network-centric  paradigm,  individual  sensors  address  the  needs  of  the  BF  as  a 
whole,  overcoming  the  platform-centric  architecture,  which  constrains  sensor  use  to  individual  platform's  needs.  Such  BF 
level  thinking  shifts  the  focus  from  legacy  stovepipe  systems  and  platforms  with  little  or  no  collaboration  incentive,  to 
optimized  uses  of  resources  that  transcend  platform  boundaries  and  span  multi-threat  dimensions.  This  paper  explores 
interoperability  problems  and  root  causes  associated  with  legacy  Naval  BF  sensor  management  and  poses  solutions  and 
considerations  for  a  network-centric  sensor  resource  manager  that  functions  as  part  of  a  BF  system  of  systems 

Network-centric  sensor  resource  management  relies  on  viewing  the  BF  as  a  single  integrated  interoperable  combat 
system  of  systems,  rather  than  a  collection  of  loosely  connected  surface,  subsurface,  and  air  platforms.  Information 
concerning  the  tactical  battle  space  and  BF  resources  (status  &  capabilities  of  sensors,  weapons,  communications,  etc.)  must 
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be  timely,  accurate,  and  consistent  across  the  BF  in  order  to  enable  optimized  sensor  command  and  control.  This  paper 
contrasts  various  BF  command  and  control  architectures  and  infostructures  (information  architectures)  based  on  their  ability 
to  best  support  sensor  resource  management  for  BF  needs.  In  addition  the  paper  addresses  information  requirements 
necessary  to  support  the  network-centric  sensor  resource  manager  and  explores  decision-making  techniques,  human-machine 
interactions,  and  levels  of  automation  for  a  network-centric  sensor  resource  manager 


Problems  Plaguing  the  Network  Centric  Paradigm 


Bonnie  Worth  Johnson 

Digital  System  Resources,  Inc 

2341  Jefferson  Davis  Hwy,  Suite  810 

Arlington,  VA  22202 

(703)  298-4577;  (703)  418-9157  (Fax) 

bwiohnson@dsrnet.com 


John  M.  Green 

University  of  California,  San  Diego 
16346  Santa  Cristobal  St. 

San  Diego,  CA  92127 

(858)  673  0856;  (858)  673  01 19 

imgreen@san.rr.com 


Raymond  Thornber 

Raytheon 

8680  Balboa 

San  Diego,  C A  92123 

(858)-522-4209,  858)-522-2010  (Fax) 

r  i  thornber  @  west .  ra  vtheo  n .  com 


In  order  to  implement  Joint  Vision  2010,  a  network  centric  paradigm  is  required  in  which  layers  of  defense  systems 
(differing  in  geographical  separation,  technical  function,  operational  employment,  and  Service  affiliation)  interoperate  and 
function  collectively  as  a  system  of  systems.  Key  to  this  cooperation  is  timely  and  accurate  information  and  knowledge 
sharing  with  a  goal  of  achieving  information  superiority.  This  information  interoperability  forms  the  fundamental  basis  for 
achieving  precision  engagement  and  time  critical  targeting,  ultimately  necessary  for  attaining  the  “Joint  Vision”  -  gaining 
full  spectrum  dominance.  Emerging  from  the  set  of  plaguing  problems  are  architectural  features  and  patterns  that  formulate  a 
network  centric  solution.  An  example  of  the  solution  set  is  the  convergence  of  the  various  “information  loops”  (i.e.,  the  JPN, 
JDN,  and  JCTN)  that  are  currently  separated  according  to  their  inherent  time  domains  (non-real-time,  near-real-time,  and 
real-time).  Information  synchronization  between  time  domains  is  as  critical  as  synchronization  across  geographically 
separated  platforms.  The  emerging  solution  set  is  used  in  the  synthesis  of  a  logical  architecture  necessary  for  converting  the 
network  centric  paradigm  from  a  “Joint  Vision”  into  a  “Joint  Reality.” 

This  paper  discusses  root  causes  of  interoperability  problems  that  plague  the  network  centric  paradigm.  Naval  systems 
are  used  as  an  analysis  starting  point  and  then  extended  to  the  Joint  realm.  The  analysis  assumes  a  network  centric  warfare 
perspective  in  which  the  Naval  Battle  Force  (BF)  is  viewed  as  the  network  comprised  of  platforms  (i.e.,  ships,  submarines, 
and  aircraft)  as  nodes  within  the  network.  In  order  to  extend  the  analysis  to  the  Joint  realm,  the  Naval  BF  becomes  treated  as 
a  node  within  an  integrated  network  of  multi-Service  forces.  This  network  centric  vision  requires  a  layered  defense  of 
individual  nodes  capable  of  operating  independently  yet  seamlessly  integrating  into  a  coordinated  network. 


Surface  Ship  Signature  Cost-Effectiveness 


James  H.  King 

Head,  Electromagnetic  Signature  Department 
9500  MacArthur  Boulevard  Code  74 

NAVSEA,  Naval  Surface  Warfare  Center,  Carderock  Division 
West  Bethesda,  MD  20817-5700 

(301)  227-1311;  FAX  (301)  227-2539,  KingJH@nswccd.navy.mil 

Many  studies  have  attempted  to  quantify  the  benefits  of  signature  control  for  surface  ships.  Far  fewer  studies  have 
quantified  the  costs.  Now,  as  the  Navy  considers  ships  designed  especially  for  littoral  operations,  the  situation  becomes  even 
less  clear.  In  these  cases,  the  benefits  are  not  well  established,  and  costs  are  not  addressed.  In  this  study,  we  will  enhance  the 
understanding  of  the  benefits  for  these  future  ships  and  gain  a  clearer  understanding  of  the  costs  across  a  wide  spectrum  of 
ships.  We  will  especially  address  the  impact  of  evolving  threat  technology  on  these  benefits  and  costs.  The  study  is  beginning 
in  March  2002.  The  presentation  will  outline  the  current  understanding,  describe  the  process,  and  provide  any  emerging 
results.. 


UH-60A,  SH-60B,  SH-60F,  HH-60J,  MH-60K,  UH-60L,  CH-60S:  Are  They  All  the  Same? 

Michael  A.  Martinez  Capt.  US  Air  Force  Charles  W.  Slade 

JSHIP  JT&E  -  Bldg  319  NAWCAD  4.1 1.3.2  -  Bldg  21 13 

22707  Cedar  Point  Rd,  Unit  1 ,  22717  Saufley  Road 

Patuxent  River  NAS,  MD  20653  Patuxent  River  NAS,  MD  20653 

(301)  342-4936  x  131,  martinezma2 @navair.navv.mil  (301)  342-4936  x  209,  sladecw@navair.navy.mil 

In  response  to  the  terrorism  of  11  Sep  01,  Operation  Enduring  Freedom  is  underway.  Much  of  our  nation’s  military 
might  is  involved — Air  Force  bombers.  Navy  ships.  Marine  Corp  troops,  and  Army  Special  Operations.  How  will  they  work 
together  to  project  power  deep  into  enemy  territory?  This  question  has  our  military  reviewing  the  requirements  for  joint 
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shipboard/helicopter  interoperability.  As  Operation  Enduring  Freedom  has  already  proven,  the  US  Army  and  Air  Force  must 
be  prepared  for  joint  operations.  The  Office  of  the  Secretary  of  Defense  (OSD)  chartered  the  Joint  Shipboard  Helicopter 
Integration  Process  (JSHIP)  Joint  Test  and  Evaluation  (JT&E)  program  back  in  1998  to  answer  such  issues. 

The  backbone  of  interservice  rotorcraft  aviation  is  Sikorsky’s  H-60 — the  Army  has  over  1500  of  these  airframes,  the  Air 
Force  has  just  over  100,  and  the  Navy  looks  to  transition  to  an  all-H-60  helicopter  fleet.  JSHIP  has  taken  on  the  unique 
challenge  of  conducting  an  H-60  similarity  study.  Currently,  H-60  similarity  research  is  being  duplicated  by  the  services 
and/or  tends  to  be  service-derived  independently.  This  study  provides  answers  in  most  aspects  where  H-60s  have  traditionally 
been  perceived  as  being  equal.  Taking  unbalanced  historical  data,  this  study  proceeded  to  analyze  the  low  airspeed  flight 
characteristics  of  seven  different  H-60  models.  The  primary  analytical  technique  was  Exploratory  Data  Analysis  (EDA).  The 
results  from  this  analytical  method,  though  not  statistically  comprehensive,  will  be  used  in  support  of  standardization  of 
shipboard  launch/recovery  envelope  development  for  Navy,  Army,  and  Air  Force  H-60  variants.  This  presentation  will  center 
on  the  basic  conclusions  from  the  historical  data  and  a  challenge  to  continue  to  refine  flight  test  analytical  procedures. 

Crossbow  Project 

Dave  Olwell 

School  of  Operational  and  Information  Sciences 

Naval  Postgraduate  School 

Monterey  CA  93943 

(831)-656-2484,  dhol well @nps.navv.mil 

"Crossbow"  is  a  year-long  project  by  about  10  professors  and  40  students  at  NPS.  The  aim  was  to  explore  the  potential  of 
a  10,000  ton  UCAV/UAV  carrier  as  a  force  component  in  littoral  operations.  The  design  complements  small  "streetfighters" 
and  high  speed  amphibious  ships.  Crossbow  comprises  45-50  knot  formations,  tailored  to  task,  for  independent  operations 
inshore.  It  can  also  supplement  a  Blue  Water  naval  force  in  a  MTW  or  other  large  scale  operation,  acting  as  its  advance, 
distributed  component.  Crossbow  was  tested  in  five  scenarios.  A  notional  force  is  8  "Sea  Archers,"  each  carrying  8  15,000  lb 
"Sea  Arrow"  UCAVs,  8  lighter  UAV  scouts,  and  2  H-60  type  helicopters;  20  "Sea  Lance"  600  ton  surface  combatants;  and  2- 
4  "Sea  Quiver"  CLF  ships. 

This  presentation  will  provide  a  summary  of  the  "Crossbow"  project,  including  a  video  describing  and  chronicling  the 
students'  work. 

An  Analysis  of  Engagement  Coordination  Methodologies  of  Aegis  Platforms 

Christopher  Zaffram 

Naval  Surface  Warfare  Center  Code  N92 
17320  Dahlgren  Rd. 

Dahlgren,  VA  22448-5100 
540-653-5947,  czaffra @ ns wc . na v v . mi  1 

As  both  communications  bandwidth  increases  and  computing  capability  continues  to  become  more  sophisticated,  the 
ability  to  share  information  and  resource  states  across  platforms  in  real  time  becomes  more  realizable.  Thus,  the  potential  for 
a  complete  realization  of  the  vision  of  Network  Centric  Warfare  comes  closer  to  reality.  With  these  advances  and  the 
constantly  evolving,  more  dangerous  threats,  the  need  for  multi-platform  Distributed  Weapon  Control  (DWC)  becomes 
inevitable.  DWC  consists  of  three  components,  namely.  Threat  Assessment,  Sensor  Coordination  and  Engagement 
Coordination.  Engagement  Coordination  is  the  utilization  of  forces,  networked  information  and  resources  in  a  more  effective 
way  to  defeat  the  enemy  and  is  the  topic  of  interest  in  this  brief. 

The  High  Performance  Distributed  Computing  (HiPer-D)  laboratory  is  a  real-time  laboratory  located  in  Dahlgren 
Virginia  where  multiple  Aegis  tactical  system  platforms  are  prototyped  in  order  to  demonstrate  proofs  of  concepts  with 
respect  to  advanced  computing  architecture  and  algorithm  development.  There  it  was  shown  that  a  multi-objective  algorithm 
could  make  a  decision  in  a  tactical  environment  in  real-time  by  sharing  fire  control  information  across  Aegis  platforms.  The 
next  phase  was  to  show  value  added  to  the  battle  group.  This  brief  describes  the  current  Engagement  Coordination  schemes 
in  the  Navy  Fleet  today.  It  then  demonstrates  through  modeling  how  using  shared  high  fidelity  fire  control  information, 
platform  state  information  across  platforms  and  a  multi-objective  decision  algorithm  can  improve  battle  group  effectiveness. 
The  focus  of  this  brief  is  to  show  the  value  added  using  a  multi-objective  decision  algorithm  to  select  the  shooter  over  the 
current  Engagement  Coordination  schemes  used  in  the  Navy  fleet  today.  Additional  discussion  includes  how  this 
methodology  can  be  extended  to  other,  non- Aegis  platforms  due  to  the  generic  criteria  and  required  interfaces. 
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JWARS:  Littoral  Warfare 

CDR  Boots  Barnes,  USN 

OSD  PA&E,  JWARS  Office 
1555  Wilson  Blvd,  Suite  620 
Roslyn,  VA  22209 
(703)-696-9490  FAX  (703)-696-9563 
barness@osd.pentagon.mil 

The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  constructive  simulation  that  shall  provide  a  multi-sided 
and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  CINCs,  Joint  Task  Force  (JTF) 
Commanders/Staff,  Services,  Joint  Staff,  Office  of  the  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS 
will  be  capable  of  performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  IOC,  and  will  be  able  to  perform  System 
Effectiveness  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  FOC. 

This  presentation  will  provide  insight  into  the  Maritime  warfighting  functionality  that  has  been  designed  into  the 
JWARS  simulation  to  date.  Discussion  will  center  around  Maritime  C4ISR,  Surface  Warfare,  Mine  Warfare,  Naval  Surface 
Fire  Support,  Undersea  Warfare,  Undersea  Warfare,  Naval  Blockade,  Aegis  TBMD  and  Forcible  Entry  (Amphibious 
Warfare).  A  Screen  Cam  image  of  the  simulation  will  be  available  at  MORSS  and  will  provide  a  point  of  discussion  where 
appropriate.  The  Joint  Analytic  Model  Improvement  Program  (JAMIP)  is  the  proponent  of  the  JWARS  model.  The 
associated  JAMIP  Executive  Committee  (EXCOM)  and  Steering  Committee  (SC)  are  the  associated  approval  authorities  for 
the  JWARS  program.  This  presentation  will  discuss  the  importance  of  Joint  warfare  and  its  relationship  to  Maritime 
capabilities  along  with  JAMIP  oversight  to  the  program. 

Trends  for  Objective  Force  Concept  Development 

Louis  G.  Bornman,  Jr.,  GS-13 
US  Army  TRAC,  255  Sedgwick 
Fort  Leavenworth,  KS  66027-2345 
Commercial  Phone,  913-684-9168,  FAX  -9189 
bornmanl  @  trac.armv.mil 

This  presentation  presents  the  findings  of  a  review  of  selected  studies  and  analyses  of  potential  future  force  concepts  that 
have  been  used  by  the  U.S.  Army  Training  and  Doctrine  Command  (TRADOC)  in  the  early  development  of  Objective  Force 
concepts.  The  report  derives  important  and  consistent  trends  from  the  source  studies,  and  establishes  a  linkage  between 
these  trends  and  elements  of  the  current  Objective  Force  Operational  and  Organizational  (O&O)  Concept,  Joint  Vision  2020 
and  the  Army  Vision.  This  effort  supports  further  development  of  the  Objective  Force  O&O  Concept  by  establishing  a  basis 
for  core  concepts  and  characteristics. 

Search  &  Destroy  ...  then  Rebuild  Quickly! 

Michael  A.  Bressler 

1660  Jeb  Stuart  Road 

Ft.  Bliss,  Texas  79916-6816 

915-568-2185/2184,  bresslermichael@otc.armv.mil 

"  Becoming  more  efficient  is  the  third  major  challenge  confronting  America's  Army.  By  becoming  efficient,  the  Army 
intends  to  garner  savings  to  help  ensure  it  can  maintain  a  force  structure  commensurate  with  operational  commitments...  By 
taking  advantage  of  technological  advances,  streamlining  our  processes,  and  reorganizing  our  institutions  the  Army  can  gain 
significant  savings  and  improve  effectiveness  and  efficiency..."  -Secretary  of  the  Army  from  his  Statement  to  Congress  on 
the  Posture  of  the  United  States  Army  for  FY97  (Chapter  4). 

The  Army's  commitment  to  achieving  efficiency  during  peacetime  by  exploring  (and  using)  technical  innovation  may 
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now  have  a  wartime  spin-off  advantage  as  America  engages  a  world-wide  war  against  terror  for  an  undetermined  period  of 
time.  Usually  the  opposite  is  true,  wartime  pressures  on  industry  to  develop  more  lethal  war  components  tend  to  generate 
post-war  improvements  for  society  in  general.  Now  that  the  great  war  against  terror  is  on,  a  sounder,  more  efficient  procedure 
needs  to  be  considered  for  post-combat  reconstruction  as  a  means  to  maintain  the  momentum  in  counter-terrorist  operations. 
In  this  war  its  not  enough  to  kill  the  enemy  quickly  through  instant  and  overwhelming  means  only  to  be  haunted  later  by 
collateral  devastation  to  an  innocent  general  population.  This  mistake  invites  a  resurgence  of  sympathy  for  the  defeated 
regime  or  at  a  minimum  sharpens  an  excuse  for  hatred  against  America  which  other  foreign  enemies  are  only  too  happy  to 
contrive.  How  to  foil  this  possibility  by  better  utilizing  America's  strategic  power  to  rebuild  as  an  extension  of  its  combat 
power:  it  is  about  rapid  development  as  the  flip  side  of  rapid  deployment.  It  is  about  blunting  the  enemy's  favorite 
counterattack:  the  inspiring  of  hatred  by  equating  America  to  a  victim's  misery  and  hopelessness.  The  paper  will  touch  on  an 
aspect  of  military  thinking  that  needs  rejuvenation,  an  adjustment  to  the  notion  that  complete  devastation  will  guarantee  the 
destruction  of  the  physical  enemy  when  the  true  enemy  is  always  hunger,  poverty,  desperation,  and  chaos  -  the  new  Four 
Horseman  -  ushering  in  an  age  of  terror. 

This  paper  is  about  an  aspect  of  military  thinking  that  needs  up-dating,  a  modification  to  the  notion  that  complete  enemy 
devastation  will  guarantee  the  destruction  of  terrorism.  In  some  instances  this  paper  will  offer  revolutionary,  bold,  new  and 
creative  vision  that  pushes  the  envelope  on  achieving  results  through  the  rapid  application  of  innovation.  Then  suggest 
making  it  a  part  of  the  standard  military  operation  against  terrorists.  American  ingenuity  is  the  most  valuable  intellectual 
asset  our  Country  possesses,  yet  its  management  (at  times)  has  been  allowed  to  stagnate. 

Decision  Superiority:  What  It  Is,  Why  It  Is  Important,  and  How  We  Can  Do  It  Better 

Dr.  Peter  Brooks 

Institute  For  Defense  Analyses 

4850  Mark  Center  Drive,  Alexandria,  VA  22311 

703-845-2170,  pbrooks@ida.org 

Last  year  the  Institute  for  Defense  Analyses  sponsored  a  Workshop  on  Decision  Superiority.  Fundamental  to  the  precepts 
of  Joint  Vision  2020,  Decision  Superiority  is  defined  as  “better  decisions  arrived  at  and  implemented  faster  than  an  opponent 
can  react. .  .at  a  tempo  that  allows  the  force  to  shape  the  situation  or  react  to  changes  to  accomplish  its  mission.”  The  purpose 
of  the  Workshop  was  to  gain  an  improved  understanding  of  the  enabling  elements  of  Decision  Superiority  and  to  describe 
how  to  organize,  deliver,  and  use  information  to  achieve  this  capability.  The  Workshop  provided  an  opportunity  for  experts 
in  training,  information  technologies,  command  and  control  organizations  and  doctrine,  and  behavioral  science,  as  well  as 
senior  military  personnel,  to  focus  critical  thinking  on  this  important  topic.  Ultimately,  we  plan  to  define  metrics  that 
describe  our  ability  to  achieve  Decision  Superiority.  This  briefing  will  carefully  define  what  is  met  by  decision  superiority 
and  will  discuss  8  recommendations  emanating  from  the  workshop  on  actions  the  U.S.  can  take  to  achieve  it. 

Design  Principles  of  Distributed  Naval  Forces 

Jeffrey  R.  Cares 

President,  Alidade  Consulting 
31  Willow  Street,  Newport,  RI  02840 
(401)935-9961;  (425)871-5466  (Fax) 
ieff@alidade.net 

Defense  community  innovators  have  proposed  concepts  that  use  cutting-edge  technologies  to  solve  long  standing 
military  challenges,  including  destruction  of  time-critical  targets,  theater-wide  surveillance  and  power  projection  and  access 
to  contested  littorals.  These  concepts  assume  great  benefit  from  networking  of  unmanned,  distributed  force,  but  a  useful 
definition  of  networked  forces  does  not  yet  exist  and  the  advantages  of  networking  have  not  been  fully  and  convincingly 
expressed.  This  document  defines  and  describes  how  “Distributed  Forces”  provide  Information  Age  advantage  and  offers 
some  design  principles  for  future  distributed  naval  forces. 


Campaign  Analysis  /Decision  Support  System  for  Unified  and  Component  Commanders 


Mr.  Reid  O.  Carlock 

U.S.  Central  Command  (CCJ8-AR) 
7115  South  Boundary  Blvd,  Bldg  540 
MacDill  AFB,  FL  33621-5101 
(813)  827-5417;  FAX  (813)  827-4919 
carlockr@centcom.mil 


COL  Eduardo  Cardenas  USA 
U.S.  Central  Command  (CCJ8-AR) 
7115  South  Boundary  Blvd,  Bldg  540 
MacDill  AFB,  FL  33621-5101 
(813)  827-4326;  FAX:  (813)  827-4919 
cardene@centcom.mil 
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USCENTCOM  has  been  engaged  in  Operation  Enduring  Freedom  since  the  terrorist  attacks  on  the  World  Trade  Center 
and  Pentagon  on  11  September  2001.  Operational  plans  and  orders  have  been  issued  with  missions  for  Component  and 
Supporting  Commanders.  To  assess  campaign  progress  against  strategic,  operational,  and  tactical  objectives,  USCINCCENT 
has  established  a  Campaign  Objectives  Assessment  Board  (COAB).  It’s  chaired  by  the  Director  J8  and  comprised  of  HQ 
staff,  Component  liaison  officers,  and  representatives  from  allied/coalition  partner  countries.  The  COAB  Chair  routinely 
briefs  the  CINC,  Coalition  partners,  and  other  planning  boards  in  the  HQ. 

To  support  the  COAB,  the  Assessment  and  Requirements  Division  (CCJ8-AR)  at  CENTCOM  has  developed  a  Campaign 
Analysis  /  Decision  Support  System  (CA/DSS).  The  CA/DSS  methodology  involves  establishing  a  hierarchical  set  of 
objectives  from  the  campaign  (theater-level)  ...  to  the  operational  ...  to  the  tactical.  It  allows  for  the  further  breakdown  of 
tactical-level  objectives  into  military  tasks,  and  measures  of  effectiveness  (MOEs).  Designated  HQ  and  Component 
representatives  enter  objective,  task,  and  MOE  information  from  their  respective  operational  locations.  They  also  set 
importance  factors  for  each  and  make  assessments,  beginning  at  the  MOE  level.  For  military  tasks  with  several  MOE,  each 
MOE’s  “rating”  is  weighted  by  its  “importance.”  The  net  assessment  at  the  military  task  level  is  the  “weighted  average”  of 
the  aggregate  MOE.  This  same  “weighted  average”  algorithm  is  applied  at  each  successively  higher  level  as  assessments  are 
"rolled  up”  to  the  theater  campaign  level. 

In  addition  to  capturing  current  assessments  as  events  occur,  CA/DSS  enables  planners  to  project  when 
objectives/tasks/MOEs  are  expected  to  be  achieved.  Comparisons  of  “current”  vs.  “projected”  states  of  campaign  progress 
will  reveal  where  actual  results  are  either  lagging,  on  track,  or  exceeding  planned  timeframes.  From  these  aggregate 
assessments,  conclusions  can  be  drawn  and  recommendations  made  to  USCINCCENT  and  other  planning  boards  in  the  HQ 
regarding  required  operational  adjustments. 

Improving  Deployment  Velocity  at  the  SPOD:  A  Force  Mobility  Characteristics  Analysis 

Dr.  Michael  F.  Cochrane, 

Military  Traffic  Management  Command  Transportation  Engineering  Agency 

Newport  News,  VA  23606 

(757)  599-1628,  FAX  (757)  599-1560 

cochranm@tea-emh  1  .armv.mil 

Studies  of  simulated  deployments,  as  well  as  real-world  experience,  have  repeatedly  pointed  to  the  air-  or  seaport  of 
debarkation  (APOD/SPOD)  as  the  most  constraining  part  of  the  military  transportation  system.  Relaxing  this  constraint  will 
result  in  improved  flow  of  military  cargo  and  improved  force  closure.  Reducing  the  deployment  weight  of  Army  units  will 
improve  SPOD  throughput,  however,  reducing  the  weight  of  all  unit  equipment  across  the  board  may  not  yield  the  greatest 
reduction  in  unit  throughput  times.  This  study  hypothesizes  that  100  percent  mobile  and  roadable  combat  units  will  be  more 
deployable  than  conventional  units,  even  if  their  deployment  footprint  is  increased  by  adding  more  organic  cargo  vehicles.  A 
100  percent  mobile  unit  will  be  able  to  clear  a  sea-  or  airport  of  debarkation  on  its  own,  eliminating  a  large  number  of 
transportation  line  haul  requirements,  thereby  improving  system  flow.  Moving  from  track-based  to  wheeled  systems  may 
potentially  reduce  the  need  for  heavy  equipment  transporters  or  railcars.  In  this  research-in-progress,  designed 
experimentation  is  used  to  investigate  the  relative  importance  of  SPOD  resources  and  infrastructure,  as  well  as  the  mobility 
characteristics  of  the  deploying  force.  A  stochastic  simulation  model  of  port  activity,  PORTSIM,  is  used  to  simulate  the 
deployment  of  a  notional  division-sized  force.  Unit  Equipment  Files  are  modified  to  model  the  effect  of  a  theoretical,  all- 
wheeled,  self-mobile  force.  It  is  expected  that  experimentation  will  identify  the  most  significant  factors  in  port  throughput  as 
well  as  provide  force  design  criteria.  The  results  of  this  research  is  expected  to  show  that  at  least  as  much  emphasis  be  placed 
on  designing  forces  for  improved  self-deployability  as  is  placed  on  strategic  lift  or  deployment  infrastructure. 

Littoral  Warfare  Handbook  for  Surface  Combat  System  Engineering 

David  Flanigan 

The  Johns  Hopkins  University  Applied  Physics  Laboratory 
11100  Johns  Hopkins  Road 
Laurel,  MD  20708 

(240)228-8129  (240)  228-5910  (Fax) 

David.Flanigan@ihuapl.edu 

Approved  abstract  unavailable  at  printing. 
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Joint  Global  Positioning  System  Combat  Effectiveness  (JGPSCE)  Joint  Test  and  Evaluation  (JT&E) 

Captain  Michael  Kram 

JGPSCE  JTF 
2050A  2nd  Street  SE 
Kirtland  AFB,  NM  87117 
505-853-1719  FAX  505-853-1974 
michael.kram@afotec.af.mil 


On  29  July  1999,  the  Office  of  the  Secretary  of  Defense  (OSD),  Deputy  Director,  Developmental  Test  and  Evaluation 
(DD,DT&E),  Strategic  and  Tactical  Systems  (S&TS),  in  cooperation  with  the  Joint  Chiefs  of  Staff  and 
the  Services,  chartered  the  JGPSCE  Joint  Test.  Over  a  four-year  period,  the  JGPSCE  JT  is  conducting  a  series  of  test  events 
that  focus  on  joint  operations  where  the  Global  Positioning  System  (GPS)  is  denied  or  degraded 

by  hostile  electronic  warfare  (EW)  or  friendly  electromagnetic  interference  (EMI).  Specifically,  the  JGPSCE  JT  is  addressing 
the  following  issues: 


Issue  1:  What  is  the  impact  of  GPS  vulnerabilities  on  the  effectiveness  of  joint  operational  missions  that  require  precision 
engagement? 

Issue  2:  What  changes  in  joint  tactics,  techniques,  and  procedures  (TTPs)  or  system-level  mitigation  techniques  improve 
or  maintain  joint  operational  mission  effectiveness  in  the  event  of  GPS  EW  and  EMI? 

Issue  3:  What  test  methodologies  can  be  employed  to  characterize  GPS  vulnerabilities  in  future  acquisition  and 
integration  programs? 

The  JGPSCE  JT  conducted  its  second  field-test  ~  GYPSY  BRAVO  Part  1  -  from  9  through  25  Jan  02  at  Naval  Air  Station 
Fallon  Range  Training  Center.  The  focus  of  the  second  test  was  to  assess  the  impact  of  EW  and  EMI  on  a 
selected  set  of  weapon  systems  including  precision  guided  munitions.  This  presentation  will  highlight  the  JGPSCE  test 
concept,  methodology,  and  preliminary  results. 

UH-60A ,  SH-60B ,  SH-60F,  HH-60J ,  MH-60K,  UH-60L,  CH-60S:  Are  They  All  the  Same? 


Michael  A.  Martinez 

Capt,  US  Air  Force 
JSHIP  JT&E -Bldg  3191 
22707  Cedar  Point  Rd,  Unit  1 
Patuxent  River  NAS,  MD  20653 
(301)  342-4936  x  131 
martinezma2@navair.navv.mil 


Charles  W.  Slade 
GS-12 

NAWCAD  4. 1 1 .3.2  -  Bldg  2 1 1 3 
22717  Saufley  Road 
Patuxent  River  NAS,  MD  20653 
(301)  342-4936x209 
sladecw@navair.navy.mil 


In  response  to  the  terrorism  of  11  Sep  01,  Operation  Enduring  Freedom  is  underway.  Much  of  our  nation’s  military 
might  is  involved — the  Air  Force  bombers.  Navy  ships.  Marine  Corp  troops,  and  Army  Special  Operations.  How  will  they 
work  together  to  project  power  deep  into  enemy  territory?  This  question  has  our  military  reviewing  the  requirements  for  joint 
shipboard/helicopter  interoperability.  As  Operation  Enduring  Freedom  has  proved,  the  US  Army  and  Air  Force  must  be 
prepared  for  joint  operations.  The  Office  of  the  Secretary  of  Defense  (OSD)  chartered  the  Joint  Shipboard  Helicopter 
Integration  Process  (JSHIP)  Joint  Test  and  Evaluation  (JT&E)  program  back  in  1998  to  answer  such  issues. 

The  backbone  of  interservice  rotorcraft  aviation  is  Sikorsky’s  H-60 — the  Army  has  over  1500  of  these  airframes,  the  Air 
Force  has  just  over  100,  and  the  Navy  looks  to  transition  to  an  all-H-60  helicopter  fleet.  JSHIP  has  taken  on  the  unique 
challenge  of  conducting  an  H-60  similarity  study.  Currently,  H-60  similarity  research  is  being  duplicated  by  the  services 
and/or  tends  to  be  service-derived  independently.  This  study  provides  answers  in  most  aspects  where  H-60s  have 
traditionally  been  perceived  as  being  equal.  Taking  unbalanced  historical  data,  this  study  proceeded  to  analyze  the  low 
airspeed  flight  characteristics  of  the  different  H-60  models.  The  primary  analytical  technique  was  Exploratory  Data  Analysis 
(EDA).  The  results  from  this  analytical  method,  though  not  statistically  comprehensive,  will  be  used  in  support  of 
standardization  of  shipboard  launch/recovery  envelope  development  for  Navy,  Army,  and  Air  Force  H-60  variants.  This 
presentation  will  center  on  the  basic  conclusions  from  the  historical  data  and  a  challenge  to  continue  to  refine  flight  test 
analytical  procedures. 
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Conventional  Weapon  Systems  and  Homeland  Security:  A  First  Look 

Richard  Phares 

Booz,  Allen  &  Hamilton 

3190  Fairview  Park  Drive 

Falls  Church,  VA  22042 

(703)  284-5356  (703)  289-5837  (Fax) 

phares.rich@bah.com 

As  part  of  the  immediate  response  to  the  events  of  1 1  September  2001,  two  PERRY  class  frigates  and  one  SPRUANCE 
class  destroyer  sortied  from  their  respective  homeports  and  took  up  assigned  defensive  positions  inside  Puget  Sound.  The 
SPRUANCE  was  assigned  to  defend  NAVSUBASE  Bangor,  and  the  ballistic  missile  submarines  based  there.  The  two 
PERRY’s  were  assigned  to  defend  metropolitan  Seattle,  and  NAVSTA  Bremerton,  and  the  nuclear  capable  shipyard  there. 
Air  cover  for  the  region  was  provided  by  Air  Force  elements  based  out  of  Portland,  OR.  The  problem  with  this  assignment 
was  not  the  obvious  beneficial  psychological  boost  to  the  local  civilian  population,  but  rather  the  capability  of  the  sensors  and 
weapon  systems  on  each  if  these  platforms  to  defeat  the  perceived  threat.  Specifically,  it  is  the  authors  contentions  that  these 
platforms,  while  designed  for  and  capable  of  conducting  combat  against  conventional  targets,  were  ill-equipped  to  deal  with 
a)  multiple  attacks  by  commercial  aircraft,  b)  car  bomb  equipped  ferries,  or  c)  other  asymmetric  physical  threats.  This  paper 
examines  why  this  is  so,  and  provides  some  recommendations  on  future  weapon  systems  to  counter  these  threats. 

When  does  the  AEF  break?  A  Quick  Look  Analysis 

Capt  David  Quick,  Lt.  Col  Harry  Conley  and  Capt.  Adam  Wallen 

HQ  ACC/DRY 

204  Dodd  Blvd  Ste  226 

Langley  AFB,  VA  23685-2777 

(757)764-7262  Fax  7217 

In  December  2001,  Gen  Hal  Hornburg,  Commander  of  Air  Combat  Command  (ACC)  asked  ACC/DRY  for  a  short-term 
analysis  of  proposed  options  for  rotating  forces  to  replace  those  already  deployed  in  support  of  Operation  ENDURING 
FREEDOM  and  NOBLE  EAGLE.  This  paper  will  present  the  results  of  that  analyses  as  well  as  discuss  the  techniques  used 
to  strike  a  balance  between  fidelity  of  the  analysis  and  the  limited  amount  of  time  allowed  to  complete  the  study.  Many 
assumptions  had  to  be  made  about  force  rotation  processes  and  data  to  provide  answers  literally  within  a  matter  of  days. 
Despite  the  lack  of  fidelity,  the  analysis  cast  new  light  on  the  decision-maker’s  problem.  The  study  found  that  the  key  to 
satisfying  critical  CINC  personnel  requirements  was  the  availability  of  trained,  deployable  personnel,  not  force  rotation 
policies.  The  study  recommended  that  the  Air  Force  focus  on  validating  requirements  and/or  increasing  personnel 
availability.  Gen.  Hornberg  called  the  work  “low  fidelity,  high  impact  analysis”.  This  study  became  the  catalyst  for  an  Air 
Force-wide  review  of  Aerospace  Expeditionary  Force  (AEF)  policies,  programs  and  organizations. 

Defining  Modeling  &  Simulation  Requirements  for  the  Joint  Strike  Fighter  Program 

Frank  Zawada 

The  Johns  Hopkins  University  Applied  Physics  Laboratory 
11100  Johns  Hopkins  Road 
Laurel,  MD  20708 

(240)  228-5089  (240)  228-0355  (Fax) 

Frank.Zawada@ihuapl.edu 

Approved  abstract  unavailable  at  printing. 
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Combat  Identification  Requirements 

Mai  Stewart  DeVilbiss  Mr.  Charles  Sadowski  Jr. 

ACC/DRSA  Combat  Identification  Requirements  Titan  Systems  Corp,  supporting  ACC/DRSA 

216  Hunting  Avenue,  Room  106  216  Hunting  Avenue,  Room  106 

Langley  AFB,  VA  23665  Langley  AFB,  VA  23665-2777 

Phone:  (757)  764-1705  stewart.devilbiss@langlev.af.mil  Phone:  (757)  764-1704  charles.sadowski@langley.af.mil 

In  order  to  field  a  Combat  Identification  (CID)  system  in  the  Air  Force,  there  is  a  requirements  process  that  must  be 
followed.  Awareness  of  and  compliance  with  requirements  documentation  is  a  critical  element  in  a  successful  CID  system 
acquisition  project.  If  CID  requirements  are  not  documented  properly  or  if  a  system  does  not  meet  the  written  requirements, 
the  CID  system  will  not  get  fielded. 

A  new  Air  Force  Requirements  and  Generation  Process  and  Procedures  Instruction  (AFI  10-601)  is  in  coordination, 
describing  a  revised  process  and  how  some  relatively  new  documents  and  processes  'fit'  into  a  well  designed  development 
and  acquisition  CID  program.  While  most  of  the  requirements  process  'remains'  unchanged,  there  are  some  new  wrinkles 
that  we  must  be  aware  of  if  we  want  to  reach  our  goal:  giving  the  warfighter  the  new  CID  capabilities  he  needs  to  meet  the 
modern  threat. 

This  briefing  describes  the  requirements  process,  as  implemented  at  ACC  in  support  of  CID  modernization.  It  covers  the 
guidance  in  the  Air  Force  instruction,  the  Joint  Mission  Needs  Statement  (JMNS)  for  Combat  Identification,  the  Capstone 
Requirements  Document  (CRD)  for  Combat  Identification,  and  some  specific  examples  of  Operational  Requirements 
Documents  (ORD)  and  System  Requirements  Documents  (SRD).  It  discusses  some  of  our  CID  success  stories  and  some  of 
the  CID  challenges  that  we  must  confront  in  the  21st  century.  Armed  with  a  better  understanding  of  how  the  requirements 
process  works,  we  should  be  able  to  make  better  decisions  regarding  thrust  areas  for  basic  scientific  research,  engineering 
development  tradeoffs  in  specific  CID  programs,  and  funding  decisions  in  the  acquisition  process. 

Modeling  of  Red  Air  Order  of  Battle  Logistics 

Mr.  Douglas  Hoffman 

Joint  Warfare  Analysis  Center 

18385  Frontage  Road,  Dahlgren,  VA  22448-5500 

Phone:  (540)  653-5865,  dhoffman @ j wac .osis.com 

This  analysis  looks  at  the  use  of  a  blue  force  logistics  model  to  evaluate  a  plan  to  isolate  an  airfield.  The  model  used  is 
the  Logistics  Joint  Analysis  Method  (LogJAM),  which  was  developed  for  the  Army  Research  Laboratory  as  the  Knowledge 
Based  Logistics  Planning  Shell  (KBLPS).  Its  original  purpose  was  to  estimate  usage  and  distribution  of  various  classes  of 
supply  for  the  U.S.  Army  logistics  planners.  Now,  LogJAM  is  employed  to  estimate  the  logistical  needs  and  shortfalls  of 
Red  forces. 

In  this  analysis  case,  the  concern  is  red  force  logistics  of  a  particular  type  of  aircraft  at  an  airfield.  This  case  was 
established  to  mimic  a  possible  military  objective.  Specifically,  it  is  assumed  that  a  force  wants  to  deny  the  enemy  the  ability 
to  use  a  specific  type  of  aircraft  in  combat.  In  order  to  eliminate  the  use  of  the  aircraft,  either  it  must  be  destroyed  or  the 
resources  that  it  utilizes  must  be  eliminated.  In  this  case,  the  goal  is  to  eliminate  these  resources,  in  particular,  aviation  fuel. 

One  way  to  obtain  the  denial  objective  is  by  cutting  the  supply  routes  to  the  airfield.  However,  in  this  case,  the 
geography  around  the  airfield  and  the  existing  local  inventory  make  it  nearly  impossible  to  isolate  the  airfield  completely  in 
order  to  ground  the  aircraft.  So,  in  addition  to  supply  route  isolation,  a  reduction  in  the  airfield  fuel  inventory  is  examined. 
As  a  result,  it  is  discovered  that  both  the  resupply  routes  and  the  inventory  must  be  affected  in  order  to  ground  the  aircraft 
over  time.  Then,  the  model  is  used  for  sensitivity  analysis  in  order  to  give  a  range  of  time  by  which  one  could  expect  the 
aircraft  to  be  grounded. 

In  addition  to  modeling  aircraft  fuel  consumption,  approaches  to  modeling  aircraft  ammunition  consumption  have  been 
tested.  Preliminary  work  is  also  being  done  for  this  type  of  supply  modeling  with  regard  to  naval  forces.  Provided  that  the 
data  can  be  gathered  and  assumptions  are  documented,  this  type  of  logistics  modeling  will  allow  for  more  realistic  impact 
assessments  on  methods  used  to  attain  military  goals. 
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Evaluation  of  ATR  Systems:  Linking  Performance  to  Military  Utility 

Dr.  John  M.  Irvine  Mr.  John  Mossing  Ms.  Lori  Westerkamp 

SAIC  Jacobs  Engineering,  Sverdrup  Technology  AFRL/SNA 

20  Burlington  Mall  Road,  #  130 
Burlington,  MA  01803  Phone: 

781-221-7620 

iohn.m.irvine@saic.com 

Automated  Target  Recognition  (ATR)  technology  is  an  important  capability  for  processing  and  exploiting  sensor  data  to 
support  military  requirements.  Evaluation  of  ATR  systems  has  focused  primarily  on  the  technical  performance  of  the 
algorithms,  particularly  under  test  conditions  that  are  controlled  or  well  characterized.  To  a  lesser  extent,  evaluations  have 
considered  systems  that  employ  a  human  operator  who  is  assisted  by  the  ATR.  While  this  approach  provides  quantitative 
performance  results  that  form  valuable  feedback  to  developers  and  useful  information  for  the  end  user,  it  does  not  directly 
address  the  military  utility  of  the  ATR  technology.  This  paper  will  present  an  approach  that  links  the  ATR  performance  to 
simple  models  of  military  engagements  and  illustrates  the  approach  with  examples.  This  approach  offers  several  benefits. 

•  Using  the  model,  observed  ATR  performance  can  be  related  directly  to  the  benefits  in  specific  military  applications. 

•  Performance  requirements  can  be  examined  in  the  context  of  the  military  mission,  leading  to  a  clearer  understanding 
of  what  is  expected  from  the  ATR  system. 

•  The  modeling  approach  supports  sensitivity  analysis  and  other  excursions  to  explore  conditions  that  are  not  directly 
observed  in  the  ATR  performance  testing. 


Air-to-Ground  Radar  Imaging  (AGRI)  Operational  Effectiveness  Modeling 
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Mr.  Jon  Wollam 

Veridian  Engineering 
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Phone:  937-476-2547 
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Objective:  The  results  of  this  study  will  provide  quantitative  data  that  defines  the  AGRI  capability  and  its  relationship  to 
other  on-  and  off-board  ID  systems.  Off-board  cueing  coupled  with  onboard  ESM  target  detection  and  classification  merge 
with  AGRI  capabilities  to  form  a  highly  effective  System  of  Systems  network.  The  team  will  evaluate  the  impact  of  each  of 
the  network  components  on  mission  effectiveness  by  varying  their  performance  characteristics.  The  purpose  is  to  find  the 
best  mix  of  capabilities  for  these  complimentary  technologies. 

Scope:  In  order  to  more  accurately  model  the  AGRI  GMTI  HRR  ATR  capability,  upgrades  to  the  GLobal  Architecture 
Combat  Identification  Effectiveness  Requirements  (GLACIER)  tool  are  required.  These  upgrades  include  an  improved 
Pdetection  and  target  tracking  module,  more  detailed  modeling  of  Pdec,  Pconf,  and  Pid  accrual,  and  more  robust  C2 
architectures.  The  measures  of  effectiveness  (MOE)  are  launches  on  the  desired  targets,  launches  on  wrong  targets,  time 
within  the  SAM  threat  envelope,  and  total  mission  time.  The  following  cases  will  be  analyzed. 

CASE  #1  -  Assigned  Target  Case. 

•  An  “automatic  target  cueing”  case;  that  is,  the  pilot  has  been  tasked  to  find  a  certain  target  in  a  region  of  interest  and 
needs  help  to  find  the  assigned  target  type/class 

•  AGRI  would  then  declare  potential  targets,  ranked  in  order  of  most  likely 

•  Confidence  (Pc)  requirement  might  be  relaxed  a  little  because  the  pilot  has  reasonable  assurance  that  the  target  is  in  the 
region  of  interest 

•  Since  the  pilot  is  only  asking  for  matches  to  a  single  target  type/class,  declarations  of  any  other  target  type  in  the  target 
database  are  not  desired 

CASE  #2  -  Automatic  Target  Recognition  (ATR)  Case. 

•  For  a  particular  cued  or  candidate  object  in  the  region  of  interest,  the  pilot  wants  to  know  with  high  confidence  the 
identity  of  the  selected  object 

•  A  high  confidence  of  correctly  identifying  the  object  (i.e.;  Pc  in  the  mid  to  high-90’s)  is  absolutely  necessary 

•  The  database  will  be  reasonably  large  and  the  entire  target  database  (or  large  subset)  will  be  searched 

•  Keep  the  possibility  of  mis-identification  extremely  low 

Conclusions:  Analysis  results  will  be  a  series  of  system  characteristics,  MOPs  and  MOEs  for  various  scenarios  and 
operating  conditions.  The  analysis  will  define  the  causality  relationships  between  off-board  cueing,  onboard  ESM  and  AGRI 
proper.  The  improved  modeling  techniques  will  be  evaluated  for  inclusion  in  the  AGRI  Critical  Experiment  (ACE)  test  bed 
while  the  analytical  results  could  be  used  to  help  design  AGRI  flight  tests  so  that  the  best  possible  results  can  be  collected 
and  analyzed. 
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The  goals  of  STIPE  are  to  reduce  the  time  and  cost  for  developing  and  maturing  promising  Uninhabited  Air  Vehicle 
(UAV)  technologies,  to  integrate  the  technologist  and  the  warfighter  into  the  Science  and  Technology  (S&T)  acquisition 
process,  and  to  provide  analytical  input  into  the  Air  Force  S&T  planning  process.  STIPE  combines  engineering-level 
modeling,  design  and  analysis  tools,  mission-  and  campaign-level  simulations,  and  cost  analysis  tools  in  a  simulation 
environment  to  provide  analytic  information  to  support  investment  decisions  in  the  Science  and  Technology  arena.  This 
simulation  environment  will  provide  the  capability  for  researchers  to  evaluate  the  impact  of  different  UAV  technologies  in  a 
warfighting  environment,  providing  a  link  between  AFRL  technologies  and  warfighter  mission  needs. 

The  STIPE  simulation  environment  is  being  applied  on  the  SensorCraft  Technology  Assessment  as  a  proof  of  concept. 
AFRLs’  SensorCraft  initiative  is  an  advanced  multi-sensor  UAV  for  standoff  ISR.  This  presentation  focuses  on  the 
campaign  level  analysis  performed  in  support  of  the  SensorCraft  Technology  Assessment.  The  goal  of  the  campaign 
analysis  is  to  provide  operational  measures  of  merit  for  return  on  investment  (ROI)  analysis  to  identify  promising  candidate 
SensorCraft  concepts.  The  variables  derived  from  the  candidate  technologies  include  the  basing  concept,  air  vehicle 
endurance,  air  vehicle  RCS,  mean  time  between  critical  failure  (MTBCF),  mean  time  to  repair  (MTTR),  ground  moving 
target  indicator/tracker  (GMTI/T)  performance,  spot  synthetic  aperture  radar  (SAR)  performance,  and  air  moving  target 
indicator  (AMTI)  performance.  The  primary  measures  of  merit  at  the  campaign  level  are  kills  by  target  type  and  campaign 
duration  required  for  operational  task  objectives. 


Combat  Identification  (CID)  Vignette  Tool 

Mr.  Steven  W.  Marlev  Dr.  J.  Kent  Haspert 

Systems  Planning  and  Analysis,  Inc.  Institute  for  Defense  Analyses 

2000  N.  Beauregard  St.,  Suite  400  1801  N.  Beauregard  St. 

Alexandria,  VA  223 1 1  Alexandria,  VA  223 1 1 

Phone:  (703)  578-6329,  smarlev@spa-inc.net  Phone:  (703)  845-2427,  khaspert@ida.org 

Despite  a  general  recognition  of  the  importance  of  CID  in  military  operations,  few  modeling  tools  make  much  of  an 
effort  to  represent  the  CID  process.  Those  modeling  tools  that  do  address  CID  typically  treat  only  a  limited  portion  of  the 
problem.  For  example,  most  models  currently  divide  the  problem  into  only  two  types  of  targets  -  friends  and  hostiles. 
However,  there  is  a  requirement  that  real  world  operations  must  perform  discrimination  between  friends,  hostiles  and 
neutrals.  Because  the  Joint  Theater  Air  and  Missile  Defense  Organization  (JTAMDO)  was  tasked  to  assess  CID 
requirements,  JTAMDO  needed  an  analytical  tool  to  facilitate  its  evaluations.  The  limitations  of  current  models  led 
JTAMDO  to  sponsor  the  development  of  a  new  analytical  tool  that  could  evaluate  both  current  and  possible  future  CID 
operations. 

The  JTAMDO  sponsored  CID  model  is  called  the  Vignette  Tool  (VT)  because  it  evaluates  the  ability  of  the  family  of 
blue  systems  to  develop  target  identification  against  a  single  target  at  a  time.  Repeated  runs  of  the  VT  allow  one  to  evaluate 
the  CID  process  throughout  an  entire  theater.  The  VT  supports  evaluations  of  multiple  types  of  targets,  ID  sensor  fusion 
techniques,  levels  of  ID  sensor  performance,  etc.  The  VT  provides  tabular  and  graphical  outputs  of  the  probability  of 
correctly  and  incorrectly  declaring  IDs  as  targets  progress  through  a  theater.  This  presentation  describes  the  numerous 
capabilities  included  in  the  VT. 


Use  of  Design  of  Experiment  (DOE)  During  Tactics  Development 

Mr.  Branford  McAllister  .  Sverdrup  Technology,  Inc.  Ms.  Cindy  Zessin,  Sverdrup  Technology,  Inc. 

308  West  D  Avenue,  Suite  1,  Eglin  AFB,  FL  32542  308  West  D  Avenue,  Suite  1,  Eglin  AFB,  FL  32542 

Phone:  (850)  729-6102,  branford . meal  1  i ster @ egl i n . af . m i  1 

The  events  of  1 1  September  will  profoundly  affect  military  affairs,  at  every  level  from  strategic  to  operational  to  tactical. 
The  fact  is,  all  activities  in  a  healthy  military-including  tactics,  doctrine,  weapons  acquisition,  joint  operations,  intelligence, 
and  combat  support-should  be  in  a  constant  state  of  positive  change.  All  of  the  services  have  well-established  processes  in 
place  to  develop  new  tactics  in  response  to  these  changes.  In  the  Air  Force,  this  process  is  most  obvious  during  Tactics 


109 


Air  Power  and  CID  WG-15 

Development  and  Evaluations,  or  TD&Es.  This  form  of  operational  testing  typically  involves  operationally  representative 
US  platforms,  employed  by  combat  qualified  crews,  in  realistic  exercises,  against  representative  live  threats,  capitalizing  on 
digital  computation  for  range  support  and  weapon  simulations.  In  fact,  these  exercises  are  run  as  close  to  combat  realism  as 
possible.  Various  tactics  are  proposed  and  then  flown  in  these  realistic  scenarios.  Results  are  collected  in  the  form  of  both 
objective,  quantitative  data  and  subjective  evaluations  from  the  participants.  Because  the  exercises  are  quite  complex  and 
involve  many  players  and  a  large  number  of  variables  (some  controllable,  some  not)  affecting  the  outcome,  and  because  the 
usefulness  of  tactics  is  often  more  opinion  than  fact,  we  have  typically  relied  heavily  upon  the  subjective  post-mission 
assessments  of  the  participants,  and  less  on  objective,  quantitative  analysis. 

The  use  of  Design  of  Experiment  (DOE)  as  a  methodology  for  setting  up  tests  and  evaluating  the  results  has  been 
essentially  non-existent  within  Air  Force  tactics  development.  Even  when  offered  to  test  managers,  arguments  against  the 
use  of  DOE  include:  DOE  will  overly  constrain  the  participants  in  realistic,  operational  testing;  the  scenarios  are  overly 
complex  for  DOE;  tactics  are  not  suitable  for  numerical  analysis;  and  DOE  demands  too  many  resources.  Recently,  there  has 
been  a  movement  within  the  Air  Force  to  utilize  DOE  during  operational  testing,  though  significant  resistance  remains. 

The  purpose  of  this  study  was  to  demonstrate  the  utility  of  DOE  in  the  tactics  development  arena  in  order  to  dispel  the 
myths  that  DOE  is  either  impractical  or  ineffective.  The  study  included  both  experimental  design  (for  example,  the  use  of 
factorial  experiments,  randomization,  independent  trials)  and  analysis  (the  use  of  ANOVA).  The  study  utilized  a  Microsoft 
Excel-based  simulation  of  aerial  combat-a  relatively  simple,  but  nevertheless  high  fidelity  model  of  aerial  combat 
engagements  involving  as  many  as  8  versus  8  players  which  was  verified  using  subject  matter  expertise.  We  then  set  up  a 
notional  tactics  development  evaluation,  with  a  number  of  control  factors  typical  of  TD&Es  (threat  electronic  warfare, 
friendly  support  assets,  threat  tactics  options,  and  friendly  rules  of  engagement)  to  assess  two  notional  friendly  tactics 
(Option  A  and  Option  B).  The  study  used  a  series  of  engagement  simulations  to  compare  the  results  obtained  using  sound 
DOE  principles  against  the  most  typical  methodologies  currently  used:  “one-factor-at-a-time”  and  “best  guess.”  The  study 
demonstrated  the  shortcomings  of  these  techniques  in  comparison  with  both  the  efficiency  and  the  effectiveness  of  results 
obtained  through  DOE. 
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The  Joint  Warfare  System  (JWARS)  model  is  the  next  generation  campaign-level  model  for  joint  analysis,  under 
development  by  the  JWARS  Program  Office  and  is  currently  undergoing  Beta  testing  for  limited  initial  operational  capability 
release.  The  model  is  intended  for  use  by  the  CINCs,  Services,  Joint  Staff,  and  OSD  PA&E,  and  the  current  release  will  be 
capable  of  performing  force  assessment.  Future  releases  will  be  able  to  address  planning  and  execution,  system 
effectiveness/trade  off  analysis,  and  concept  and  doctrine  development. 

This  presentation  will  discuss  air  warfighting  functionality  that  has  been  designed  and  implemented  to  date  in  JWARS. 
Discussion  will  center  around  the  JFAAC  mission  planning  and  execution.  This  includes  inputs  from  the  Land  and  Maritime 
Component  Commanders,  Joint  Target  Planning,  and  user  specified  plans  such  as  the  Air  Defense  Plans,  Airspace  Control 
Orders  and  Collection  Plan.  The  result  is  a  complete  Air  Tasking  Order  that  includes  Air  Defense,  ISR,  CAS,  and  targeting 
missions. 


Combat  Identification  Research  Fratricide  Study 
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This  study  categorized  the  variables  associated  with  fratricide  events  and  CID  using  a  joint  model  for  CID  mission 
analysis,  with  principal  focus  on  the  Ground-Ground  and  Air-Ground  Mission  areas.  Depending  on  the  availability  of  data, 
the  variables  included  the  unique  identification  of  the  incident,  firing  weapon  platform,  target,  casualties,  environmental 
factors,  range-to-target  and  killer- victim  pairings,  operational  environment  (physical  and  tactical  mission),  and  cause.  Data 
sources  included  investigations,  real  world  operations,  highly  instrumented  Combat  Training  Center  data.  Joint  T&E  results, 
and  Service  Safety  Center  data.  Results  characterize  fratricide,  identify  the  primary  causes,  provide  information  to  assure 
that  solutions  are  designed  to  correct  real  problems,  and  provide  input  to  development  of  a  Joint  CID  Investment  Strategy. 
The  study  provides  insights  into  the  Situational  Awareness  vice  Target  Identification  debate,  validates  CINC’s  IPL  listing 
Ground-Ground  and  Air-Ground  CID  as  major  problems,  and  verifies  the  CID  =  SA  +  TI  hypothesis. 
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Combat  IDentification  (CID)  systems  are  typically  defined,  developed,  and  initially  tested  by  the  Research  and 
Development  (R&D)  community,  which  consist  primarily  of  scientists  and  engineers.  These  systems  are  then  transitioned  to 
the  warfighters  for  operational  use. 

The  R&D  community  performs  analyses  based  on  Measures  Of  Performance  (MOPs)  such  as,  Probability  of  Declaration 
(PdecL  Probability  of  Detection  (PDet)>  Probability  of  Identification  (PID),  Probability  of  False  Alarm  (PFA),  etc.  These  types 
of  measures  are  used  to  gain  performance  insights  and  to  provide  feedback  to  the  development  process.  In  addition  to  these 
metrics,  the  operational  community  wants  to  understand  how  reliable  a  system  is  and  how  to  interpret  an  individual  CID 
system  report.  Warfighters  ask  questions  like:  “Do  I  have  enough  confidence  in  this  report  to  engage  the  target?” 

The  AFRL  COMPASE  Center  has  developed  and  applied  a  disciplined  methodology  for  the  evaluation  of  cueing  and 
recognition  systems.  Previous  papers  have  explored  an  element  of  that  methodology  related  to  the  confusion  matrix  as  a 
tabulation  of  experiment  outcomes  and  its  corresponding  summary  performance  measures.  This  paper  continues  that  work 
and  defines/develops  Probability  of  Correct  Label  (PCl)  and  Report  Confidence  (RC)  MOPs.  These  measures  aim  to  benefit 
and  bridge  the  gap  between  the  R&D  and  operational  communities.  Scientists  and  engineers  can  take  advantage  of 
operational  insights  while  the  system  is  still  in  the  R&D  phase,  while  the  warfighter  stands  to  gain  operationally  relevant 
measures  of  performance  upon  acceptance  of  the  CID  system. 

Results  from  a  study  are  presented.  Outputs  from  laboratory  based  state-of-the-art  Automatic  Target  Recognition  (ATR) 
algorithms  are  used  to  assess  the  utility  of  PCl,  and  RC. 


Simulation- Based  Technology  and  Investment  Planning  Experiment  (STIPE)  Metamodeling  as 
Applied  on  the  SensorCraft  Technology  Assessment 

Mr.  James  Shedden  Mr.  James  Zeh 

SAIC  AFRL/VACD 

Phone:  (937)904-6526  2241  Avionics  Circle 

iames.shedden@wpatb.af.mil  WPAFB,  OH  45433 

Phone:  937-904-6571;  iames.zeh@wpatb.af.mil 

Metamodeling  is  a  form  of  data  abstraction  that  allows  the  creation  of  a  “model  of  a  model.”  This  paper  provides  a 
general  approach  that  can  be  used  to  support  a  number  of  applications  where  increased  fidelity  is  needed  without  sacrificing 
run  time  performance.  A  specific  example  is  provided  that  adds  an  estimate  of  clutter  loss  and  jammer  loss  to  the  radar  range 
equation  for  a  Ground  Moving  Target  Indicator  (GMTI)  on-board  a  Sensorcraft  platform.  Engineers  at  Rome  AFB  use  a 
high-fidelity  radar  engineering  model,  BRADS  (Bi-static  Radar  System),  to  provide  detailed  estimates  of  sensor 
performance.  A  collection  of  statistical  techniques  are  used  to  provide  estimates  that  are  well  within  the  95%  confidence 
interval  of  the  values  that  would  be  returned  running  the  BRADS  model,  but  at  a  small  fraction  of  the  time  required.  Design 
Of  Experiments  (DOE)  is  used  to  ensure  the  right  data  is  collected  in  an  efficient  manner,  regression  and  curve-fitting 
methods  are  employed  to  provide  polynomial  representations  of  the  underlying  data,  and  statistical  measures  are  used  to 
validate  the  metamodel  against  the  BRADS  model.  This  metamodel  is  linked  to  the  JIMM  mission  level  simulation  to 
support  both  constructive  and  virtual  events,  providing  a  greater  degree  of  fidelity  for  evaluating  GMTI  performance  at  the 
mission  level.  By  tailoring  the  engineering-level  fidelity  to  the  weapon  system  under  study  at  the  mission  level,  a  link  is 
created  between  technologists  supporting  acquisition  and  the  warfighters  that  are  needed  to  advocate  revolutionary  new 
systems/technologies . 
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Approved  abstract  unavailable  at  printing. 


Analysts  in  the  Aerospace  Operations  Center  ( AOC ) 

Mai.  Charles  Voqt 

AFSAA 

1570  Air  Force  Pentagon 

Washington  D.C.  20330-1570 

Phone:  (703)  588-8185  charles.vogt@pentagon.af.mil 

As  a  result  of  the  focus  of  treating  the  AOC  as  a  weapon  system,  analytical  support  for  the  warfighter  has  emerged  as  a 
critical  topic.  The  need  for  analytical  support  was  identified  in  recent  and  historical  lessons  learned.  AFSAA  is  working 
with  the  AC2ISRC  to  bring  forth  military  and  civilian  analysts  to  the  AOC  to  aid  in  decision  support  to  the  JFACC  and  the 
JFC.  Why  should  analysts  be  in  the  AOC?  To  analyze  JFC/JFACC  courses  of  action  alternatives;  to  provide  percentages  of 
JFC/JFACC  objectives  achieved;  to  test  fly  and  quality  check  the  Air  Tasking  Order  (ATO)  prior  to  execution;  to  collect, 
disseminate,  and  archive  information;  and  to  provide  mission  effectiveness  vs.  attrition  rates.  AFSAA  received  approval 
from  the  AOC  SDIPT  June  2001  for  implementation  of  this  initiative.  The  implementation  process  requires  efforts  on  five 
parallel  tracks  focusing  on:  operations  assessment  tools,  training  curriculum,  CONOPS,  personnel  and  manpower,  and 
contingency  and  exercise  support.  The  issues,  challenges,  and  status  of  each  of  these  tracks  will  be  discussed.  This  effort 
simultaneously  represents  a  significant  shift  in  the  utilization  of  analysts  in  the  Air  Force  and  an  outstanding  opportunity  for 
analysts  to  demonstrate  their  operational  capabilities. 

MP-RTIP  AoA  -  Early  Engineering  Modeling  and  Digital  Simulation 

Mr.  David  Wininqer 

AC2ISRC/SMO-MC2A  (Titan-SenCom) 

402  Helms  Avenue,  Suite  222 
Langley  AFB,  VA  23665 

Phone:  (757)  225-4337  David.wininger@titan.com 

This  paper  presents  information  related  to  the  Multi-Platform  Radar  Technology  Insertion  Program  (MP-RTIP)  Analysis 
of  Alternatives  (AOA).  Engineering  modeling  played  a  key  role  in  the  MP-RTIP  AoA  from  the  outset.  The  paper  outlines 
how  engineering  modeling  was  used  in  screening  alternatives  prior  to  detailed  analysis.  The  number  of  alternatives  was 
reduced  by  50%  (from  ten  to  five)  using  parametric  analysis  accomplished  by  the  Technology  and  Alternatives  Panel.  Ten 
screening  criteria  were  developed  by  the  AoA  team.  Key  aspects  of  the  engineering  analysis  will  be  discussed  including 
sensor  Field  of  View  (FOV),  as  well  as  aircraft  Space  Weight  And  Power  (SWAP)  margin.  SWAP  margin  was  defined  in 
order  to  evaluate  multi-mission  (as  opposed  to  single-mission)  aircraft  suitability.  The  paper  also  discusses  engineering 
modeling  use  in  sensor  performance  evaluation. 

Two  MP-RTIP  AoA  models  to  be  discussed  include  EADSIM  and  Estimated  Time  on  Station  (ETOS).  Modeling  was 
conducted  by  ACC/DRY  with  input  and  oversight  from  the  MP-RTIP  AoA  Effectiveness  Analysis  Panel.  These  two  models 
provided  insight  into  operational  effectiveness.  The  EADSIM  modeling  related  to  MP-RTIP  sensor  performance,  and  was 
based  on  work  previously  accomplished  by  ACC/DRY.  The  ETOS  modeling  discussion  includes  endurance,  reliability,  and 
time  to  repair  information  relative  to  specified  operational  employment  scenarios. 
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Effects  based  Operations  (EBO)  Analysis  of  Counter  Terrorism  using  Agent  Based  Modeling 

LtCol  Eileen  Biorkman  Dr  Robert  S.  Sheldon 

DMSO  L-3  Com,  Analytics  Corp 

1900  N.  Beauregard  St,  Suite  500 

Alexandria,  VA  22316  Steve  Upton 

biorkman@dmso.mil  MITRE  upton@mitre.org 

We  present  a  methodology  using  existing  tools  from  Project  Albert  to  analyze  counter  terrorism.  Project  Albert  is  a 
research  and  development  effort  of  the  Marine  Corps  Combat  Development  Command  (MCCDC)  to  assess  the  general 
applicability  of  the  study  of  complex  adaptive  systems  (CAS)  to  warfare,  and  to  provide  new  methodologies  for  investigating 
the  results  of  running  such  models  and  incorporating  those  results  with  other,  more  traditional,  methods  of  analysis.  Two 
Project  Albert  tools  used  in  this  CT  analysis  are  Socrates,  an  agent  based  model,  together  with  a  Generative  Analysis  (GAn) 
search  heuristic.  Our  analysis  frames  CT  questions  to  be  answered  and  poses  candidate  issues  to  counter  terrorism,  We 
examine  terrorist  behaviors  and  personalities  modeled  in  Socrates  and  address  the  relationship  among  Red,  Blue  and  other 
agents.  The  GAn  heuristic  starts  by  generating  a  set  of  possible  solutions.  These  solutions  are  then  evaluated  by  Socrates.  The 
best  solutions  with  respect  to  the  desired  ‘effects’  are  saved.  The  next  set  of  trial  solutions  is  then  generated  and  the  process  is 
repeated.  We  apply  the  Effects  Based  Operations  (EBO)  to  select  the  ‘best  of  the  best’  from  the  set  of  best  solutions.  The  best 
solutions  from  the  GAn  heuristic  search  were  generated  trying  to  optimize  over  a  set  of  desired  effects  9or  goals).  Using  the 
concept  of  EBO,  we  pick  from  the  best  solutions  those  that  are  what  Dr.  Alfred  Brandstein  calls  ‘more  interesting’-that  is, 
they  are  more  robust,  or  achieve  the  effect  in  some  novel  fashion.  Finally,  we  analyze  the  more  interesting  solutions  to  gain 
insights  fro  the  CT  mission,  e.g.,  find  anti-solutions,  i.e.,  what  Red  comes  up  with  to  counter  Blue’s  best. 

Modeling  the  Global  War  on  Terrorism 

LTC  Darrell  Henderson,  PhD 

AWC 

Carlisle  Barracks,  PA 

By  declaring  a  war  against  terrorists  and  governments  who  support  terrorists  in  his  recent  address  to  the  joint  session  of 
congress.  President  Bush  erased  the  distinction  between  terrorists,  terrorist’s  organizations  and  state  sponsored  terrorism.  The 
President  also  issued  a  warning  order  to  the  American  people  that  the  primary  focus  of  his  administration  would  be 
combating  terrorism.  This  paper  discuses  a  strategy  for  conducting  the  war  on  terrorism  in  terms  of  a  system  and  how  that 
strategy  must  be  adjusted  over  the  long-term  to  compensate  for  fluctuating  components  of  the  war  on  terrorism.  A  system  to 
model  terrorism  and  the  civilized  states  that  will  fight  the  war  on  terrorism  as  systems,  a  strategy  for  combating  terrorism  can 
be  created  and  analyzed. 

Peace  Operations  Support  Tool 

Dr.  Lynda  Jaques 

CINCPAC  J081 
Liaques@vic-info.org 

At  the  69th  MORSS,  USCINCPAC  presented  a  briefing  on  an  Australian-U.S.  initiative  in  operations  research  support 
for  peace  operations.  The  tool  being  developed  under  this  initiative  has  come  to  be  known  as  the  Peace  Operations  Support 
Tool  (POST).  The  first  prototype  of  POST  has  been  oriented  towards  functions  expected  to  be  exercised  during  Cobra  Gold 
02,  a  Thai/U.S./  Singaporean  exercise  in  May  02.  This  presentation  provides  an  update  on  POST  development  and  “quick 
look”  results  of  an  assessment  conducted  during  Cobra  Gold  02. 


Mike  McCurdy 
CINCPAC  J081 
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Common  Operational  Guidelines 

Martin  Lidv 

4850  Mark  Center 
Alexandria,  VA  223 1 1 
(703)845-241  l;Fax:  (703)  845-6977 
mlidv@ida.org 

Recent  advances  within  the  U.S.  military  (including  the  development  of  CMO  and  Civil  Affairs  policy  and  doctrine)  and 
within  civilian  institutions  (e.g.,  formation  of  codes  of  conduct  and  "minimum  standards"  for  humanitarian  response)  open 
the  possibility  of  developing  a  shared  set  of  operational  guidelines  for  both  civilian  and  military  organizations  responding  to 
SSCs.  This  presentation  summarizes  the  Institute  for  Defense  Analyses  (IDA)  hosted  workshop  held  in  October  2001  to 
determine  if  such  Common  Operational  Guidelines  (COGs)  could  be  developed.  This  Workshop,  sponsored  by  the  Assistant 
Secretary  of  Defense  (Special  Operations/Low  Intensity  Conflict),  Office  of  Special  Operations  Policy  and  Support,  and  the 
United  States  Institute  of  Peace,  brought  together  representatives  of  civilian  and  military  organizations  that  respond  to 
humanitarian  and  peacekeeping  crises  abroad.  The  objective  of  the  workshop  was  to  advance  civilian-military  cooperation 
during  such  operations  by  developing  COGs.  COGs  were  defined  as  "processes  to  be  used  by  both  civilian  and  military 
operators  to  guide  their  interactions  during  peace  and  humanitarian  operations."  The  Workshop  proceeded  by  identifying  15 
key  recurring  policy  issues  faced  by  both  civilian  and  military  organizations  when  they  are  deployed  to  humanitarian  and 
peace  operations.  Participants  then  produced  6  draft  COGs  to  apply  to  these  key  recurring  policy  issues  and  started  work  on 
a  number  of  other  COGs.  In  addition,  participants  examined  how  those  COGs  developed  at  the  Workshop  should  be  vetted 
among  additional  civilian  and  military  organizations  and  gain  wider  international  acceptance  in  these  diverse  communities 

Using  Analytical  Tools  in  Support  of  a  Multi-National  Planning  Exercise 

MAJ  Mike  McCrea 

CFC/USFK  C/J3  OAB 
mccream@usfk.korea.armv.mil 

On  12  January  2002,  planners  from  24  countries  arrived  in  the  Republic  of  Korea  for  a  Multinational  Planning  Exercise, 
focusing  on  a  Humanitarian  Assistance/Disaster  Relief  (HA/DR)  scenario.  The  exercise,  known  as  Tempest  Express  3,  is  a 
PACOM  sponsored  event.  The  scenario  identified  a  potential  refugee  and  displaced  civilian  crisis  on  the  fictitious  island  of 
Parang  Do,  located  110  miles  off  the  southwest  coast  of  Korea.  At  the  request  of  PACOM,  Operations  Analysis  Branch, 
Combined  Forces  Command  Korea,  participated  in  the  exercise  and  provided  analytical  support  for  course  of  action  analysis 
using  available  operations  research  methods.  The  main  planning  effort  centered  on  providing  immediate  relief  supplies  to  the 
refugee  camps  using  limited  transportation  assets.  Additional  requirements  included  providing  security  for  food  storage  and 
initial  repairs  to  the  island’s  infrastructure.  Given  a  variety  of  intra-theater  transportation  assets,  a  linear  program  was  used  to 
provide  the  planners  with  the  optimal  delivery  method  in  order  to  reduce  storage  and  inherent  security  requirements.  To 
simulate  the  delivery  process  on  the  fictitious  island,  a  network  was  built  using  the  software  package  AweSim.  Operations 
Analysis  Branch  briefed  the  linear  program  and  the  network  at  the  conclusion  of  the  Multinational  Planning  Exercise  to  show 
the  value  operations  research  can  provide  to  an  HA/DR  crisis. 

Analyzing  Complex  Threats  for  Operations  and  Readiness  (ACTOR) 

Dr  Sean  O’Brien 

Center  for  Army  Analysis 
6001  Goethals  Road 
Ft  Bel  voir,  VA  22060 
obrien@caa.armv.mil 

Military  planners,  defense  analysts,  diplomats,  and  legislators  need  better  tools  and  models  to  provide  them  with  better 
insights  into  where,  when  and  to  what  extent  country  instabilities  might  challenge  national  security  interests  so  they  can 
anticipate,  plan  and  budget  for  these  possible  occurrences  in  advance.  This  study  draws  upon  the  state  strength  literature,  uses 
recently  developed  data-mining  tools  and  draws  upon  an  extensive  database  that  includes  annually  aggregated  data  covering 
political,  economic,  and  socio-cultural  domains  for  some  159  countries  over  the  period  1975-1999  to  forecast  the  likelihood 
that  countries  throughout  the  world  will  experience  a  certain  level  of  intensity  of  instability  over  the  period  2001-2015.  The 
study  uses  a  pattern  classification  algorithm-Fuzzy  Analysis  of  Statistical  Evidence  (FASE) — developed  by  Chen  (2000)  on 
behalf  of  the  U.S.  Army  to  identify  and  analyze  the  relationships  between  country  macro-structural  factors  and  historical 
occurrences  of  instability.  A  split-sample  validation  design  is  used  to  evaluate  the  ability  of  FASE  to  generate  competent 
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predictions,  using  the  standard  performance  metrics  overall  accuracy,  recall  and  precision.  The  results  demonstrate  the 
potential  capability  of  the  model  to  accurately  forecast  not  just  the  occurrence,  but  also  the  level  of  intensity  of  country 
instability  six  years  in  advance  with  about  80%  overall  accuracy.  The  forecasts  generated  through  the  year  2015  suggest  that 
South  Asia  and  East  Africa  will  continue  to  harbor  highly  unstable  states.  However,  most  of  the  states  expected  to  improve 
their  prospects  for  greater  stability  are  also  located  in  these  regions. 

Historical  Analysis  of  SSC  Operations  (Army) 

Herman  J.  Orqeron 

Center  for  Army  Analysis 
6001  Goethals  Road 
Ft  Belvoir,  VA  22060 
orgeron@caa.armv.mil 

The  Center  for  Army  Analysis  (CAA)  performed  the  initial  work,  called  the  Stochastic  Analysis  of  Resources  for 
Deployments  and  Excursions  (SARDE),  under  the  sponsorship  of  the  War  Plans  Division  of  the  Office  of  Deputy  Chief  of 
Staff  for  Operations  and  Plans  (DCSOPS).  SARDE’s  objectives  include  the  development  and  demonstration  of  a 
methodology  to  predict  the  requirement  for  Army  units,  by  type,  needed  to  support  simultaneous  smaller  scale  contingency 
operations  (SSC’s)  in  the  future.  In  October  2000,  the  Operations  Directorate  of  ODCSOPS  requested  an  update  using 
historical  data  to  the  greatest  extent  possible.  The  work  also  needed  to  use  any  updates  to  the  methodology.  This  study,  called 
Historical  Analysis  of  SSC  Operations  2000  (HASO  2000),  was  completed  in  2000,  revised  and  updated  in  2001  and 
provided  to  staff  agencies  in  ODCSOPS  for  use  in  their  overall  force  structure  requirements  analysis. 

Determining  Homeland  Security  Force  Structure  Requirement 

MAJ  Terence  Peterson 

Center  for  Army  Analysis 

6001  Goethals  Road 

Ft  Belvoir,  VA  22060 

(703)  806-5681,  petersot@caa.armv.mil 

Beginning  in  the  spring  of  2000,  the  Army  undertook  efforts  to  change  the  paradigm  of  treating  Homeland  Security  as  a 
lesser-included  force  structure  requirement.  The  results  of  this  shift  led  to  the  development  of  the  Army  Strategic  Planning 
Guidance  (coordinating  draft,  September  10,  2001).  This  planning  guidance  serves  as  the  framework  for  determining  the 
Army’s  force  requirement  to  support  Homeland  Security.  There  are  seven  basic  mission  types  that  are  covered  in  the 
planning  guidance.  The  study  employs  three  techniques  to  determine  the  requisite  force  structure  for  each  mission  type.  The 
first  technique  involved  collecting  known  information  of  current  force  structure  that  had  a  Homeland  Security  role.  The 
second  used  a  forecasting  tool,  Stochastic  Analysis  of  Resources  for  Deployments  and  Excursions  (SARDE)  that  uses 
historical  events  to  predict  the  average  monthly  force  requirement  for  certain  mission  types.  The  final  technique  involved 
basic  set  theory  to  estimate  the  requirement  based  on  several  possible  scenarios.  The  results  of  this  study  were  used  in  the 
Total  Army  Analysis  ’09  process  that  determines  the  desired  force  structure  that  Army  Planners  can  use  to  convey  it 
requirement  to  the  Joint  Staff  and  sister  services.  Lastly,  the  study  demonstrates  how  the  Army  is  currently  supporting  the 
National  Command  Authority’s  efforts  to  ensure  the  safety  and  security  of  the  nation. 

Balkan  Digitization  Initiative  (BDI) 

Dr.  Bruce  Robinson 

MITRE,  brobinso@mitre.org 

Late  in  1998,  the  Commander,  US  Army  Europe  (USAREUR),  requested  that  the  Program  Executive  Office  Command, 
Control  and  Communications  Systems  (PEO  C3S)  evaluate  the  use  of  Force  XXI  systems  and  technologies  to  enhance  the 
capabilities  of  the  stabilization  forces  in  Bosnia  and  Kosovo.  The  resulting  material  solution  consisted  of  a  variant  of  the 
Force  XXI  Battle  Command  Brigade  and  Below  (FBCB2),  packaged  on  a  commercial  hardware  suite  and  renamed  the 
Enhanced  Information  System  (EIS).  Due  to  the  lack  of  Enhanced  Position  Location  Radio  Systems  (EPLRS)  and  terrain 
restrictions  on  line-of-sight,  portions  of  the  QUALCOMM  OmniTRACS  system,  a  Commercial-Off-the-Shelf  (COTS) 
satellite-based  vehicle  tracking  system,  was  used  as  the  communications  path.  Additionally,  a  QUALCOMM  satellite  hub 
ground  station  was  deployed  within  the  USAREUR  Theater  to  provide  network  management.  In  Bosnia,  there  are  140 
vehicles  deployed  with  EIS  systems.  In  Kosovo,  there  are  425  such  systems.  Last  November,  70  systems  were  fielded  to 
units  of  the  Southeastern  European  Task  Force  (SETAF)  in  Italy.  The  EIS  systems  automatically  provide  patrol  vehicles 
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with  their  current  position  location,  as  well  as  the  position  location  of  adjacent  patrols,  all  without  operator  action.  These 
position  locations  are  also  being  sent  to  a  web-based  data  broker  for  worldwide  dissemination,  as  well  as  being  entered  into 
the  Global  Command  and  Control  System  (Army)  at  USAREUR  Headquarters  in  Heidelberg,  Germany  for  inclusion  into  the 
Common  Operational  Picture  (COP).  A  vehicle  to  vehicle  messaging  capability  exists,  and  at  times  is  the  only 
communications  available  to  the  soldiers  on  patrol.  Architectural  enhancements  are  being  made  to  the  system  to 
accommodate  multiple  communications  paths.  In  addition  to  OmniTRACS  (Ku-band  satellites),  these  enhancements  will 
facilitate  the  use  of  L-band  satellites,  UHF  tactical  satellites,  and  EPLRS.  When  completed,  the  EIS  systems  will  be  able  to 
operate  in  virtually  the  entire  USAEUR  area  of  operations,  which  previously  had  been  a  major  shortcoming. 

Emergency  Preparedness  Incident  Command  Simulation 
Dr  Julie  Seton  Dr  Randall  Parrish 

TRADOC  Analysis  Center,  TRADOC  Analysis  Center,  WSMR,  NM  88002 

WSMR,  NM  88002,  (505)678-4949,  (505)678-1970  (505)-678-1950,  (505)  678-4866 

setoni.contractor@trac.wsmr.armv.mil  parishr@trac.wsmr.armv.mil 

The  Emergency  Preparedness  Incident  Command  Simulation  (EPiCS)  is  a  tool  for  crisis  managers  and  their  staffs  to 
exercise  command  and  control  in  a  realistic  but  simulated  environment.  EPiCS  can  be  used  to  train  operations  command  and 
control  personnel,  rehearse  operations,  evaluate  operations  plans,  analyze  systems  effectiveness,  and  develop  techniques  and 
procedures.  EPiCS  allows  for  agencies  at  local,  county,  state,  and  federal  levels  to  exercise  their  command  structure  at 
multiple  levels  and,  at  the  same  time,  allow  many  agencies  to  interact  and  develop  or  exercise  procedures  for  interagency 
cooperation  across  jurisdiction  boundaries.  Over  the  last  two  years,  TRAC-WSMR  has  conducted  four  EPiCS  exercises 
sponsored  by  the  National  Institute  of  Justice.  These  exercises  have  involved  various  disaster/crisis  scenarios  including  a 
prison  riot,  shootings  in  a  school,  public  disturbances  that  required  mass  arrests,  and  terrorist  attacks  that  triggered  a  weapon- 
of-mass  destruction  (WMD)  release  in  a  major  city  subway.  The  methods,  processes,  and  results  of  the  project  are  described. 
TRAC-WSMR  has  agreed  to  conduct  overlapping  training  exercise  cycles  using  EPiCS  for  the  Defense  Threat  Reduction 
Agency,  (DTRA)  to  analyze  and  evaluate  site  safety  response  plans  and  procedures.  The  plans  and  emerging  results  of  these 
efforts  will  be  outlined  and  discussed. 

Multi-domain  Counter-terrorism  Modeling 

Dr.  Roger  Smith 

VP  of  Technology,  Titan  System  Corp 

3361  Rouse  Road,  Suite  200,  Orlando,  FL  32817,  rdsmith@titan.com 

A  model  of  terrorist  organizations  and  their  activities  must  address  each  of  the  components  of  a  terrorist  network  -  the 
command  nucleus,  field  cell,  group  communications,  national  hosts,  sympathizers,  and  support  assets.  Together  these  create 
a  network  that  enables  a  small  group  to  conduct  guerilla  warfare  against  any  target  in  the  world.  Modeling  our  response  to 
these  components  will  require  more  than  traditional  interactive  or  analytic  simulations.  An  appropriate  simulation  must 
include  the  resources  and  missions  of  1)  physical  assets  like  the  traditional  military,  special  forces,  security  systems  and 
personnel,  and  emergency  management  teams;  2)  intelligence  collection  against  domestic  and  foreign  targets;  3)  political 
actions  against  governmentally  sponsored  activities;  4)  legal  actions  against  non-governmental  sympathizers  and 
organizations  that  support  terrorists;  5)  financial  and  economic  sanctions  targeted  at  assets  belonging  to  terrorists  and  nations 
that  host  them;  and  6)  cultural  influences  on  potential  terrorist  recruits,  national  sentiment,  and  media  representation.  This 
presentation  will  discuss  potential  frameworks  for  approaching  this  problem  and  discovering  the  algorithms,  variables,  and 
relationships  for  such  a  system. 
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JWARS:  The  Assessment  Process  (V&V,  T&E) 


CDR  Boots  Barnes.  USN 

OSD  PA&E,  JWARS  Office 
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Rosslyn,  VA  22209 
(703)-696-9490;  Fax,  x-9563 
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Mr.  Mike  Metz,  IMC;  MAJ  Joe  Mansir.ATEC 

OSD  PA&E,  JWARS  Office 

1555  Wilson  Blvd,  Suite  620 

Rosslyn,  VA  22209 

(703)-696-9490;  Fax,  x-9563 

barness@osd.pentagon.mil 


Ms.  Sharon  Nichols  AFOTEC 
OSD  PA&E,  JWARS  Office 
1555  Wilson  Blvd,  Suite  620 
Rosslyn,  VA  22209 
(703)-696-9490;  Fax,  x-9563 
barness@osd.pentagon.mil 


The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  constructive  simulation  that  shall  provide  a  multi-sided 
and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  CINCs,  Joint  Task  Force  (JTF) 
Commanders/Staff,  Services,  Joint  Staff,  Office  of  the  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS 
will  be  capable  of  performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  IOC,  and  will  be  able  to  perform  System 
Effectiveness  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  FOC. 

This  presentation  will  provide  insight  into  the  assessment  process  of  JWARS.  The  assessment  process  includes  both 
Verification  &  Validation  (V&V)  and  Test  and  Evaluation  (T&E)  which  are  outlined  in  the  JWARS  V&V  Plan  and  JWARS 
Test  and  Evaluation  Plan  (TEP).  The  V&V  Plan,  as  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD 
VV&A  Recommended  Practices  Guide  (RPG),  modified,  where  appropriate,  for  the  JWARS  V&V  effort.  The  T&E  Plan,  as 
also  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD  5000.1  and  5000.2  acquisition  documents  for 
ACAT  III  level  programs  and  Automated  Information  Systems  (AISs),  modified,  where  appropriate,  for  the  JWARS  T&E 
effort.  The  Joint  Analytic  Model  Improvement  Program  (JAMIP)  is  the  proponent  of  the  JWARS  model.  The  associated 
JAMIP  Executive  Committee  (EXCOM)  and  Steering  Committee  (SC)  are  the  associated  approval  authorities  for  the  V&V 
process  and  T&E  process.  This  presentation  will  discuss  the  importance  of  the  assessment  process,  user  interface, 
verification  and  validation  activities,  test  and  evaluation  activities,  documentation  procedures  and  reporting  criteria.  The 
V&V  as  well  as  the  T&E  processes  encompass  the  internal  JWARS  office  efforts  as  well  as  the  V&V  agent  and  Operational 
Test  Agencies  interface  with  the  user  and  test  community. 


Campaign  Analysis  /  Decision  Support  System  for  Unified  and  Component  Commanders 


Mr.  Reid  0,  Carlock 

U.S.  Central  Command  (CCJ8-AR) 
7115  South  Boundary  Blvd,  Bldg  540 
MacDill  AFB,  FL  33621-5101 
(813)  827-5417;  Fax,x-4919 
carlockr@centcom.mil 


COL  Eduardo  Cardenas  USA 
U.S.  Central  Command  (CCJ8-AR) 
7115  South  Boundary  Blvd,  Bldg  540 
MacDill  AFB,  FL  33621-5101 
(813)  827-4326;  Fax,x-49 19 
cardene@centcom.mil 


USCENTCOM  has  been  engaged  in  Operation  Enduring  Freedom  since  the  terrorist  attacks  on  the  World  Trade 
Center  and  Pentagon  on  1 1  September  2001.  Operational  plans  and  orders  have  been  issued  with  missions  for  Component 
and  Supporting  Commanders.  To  assess  campaign  progress  against  strategic,  operational,  and  tactical  objectives, 
USCINCCENT  has  established  a  Campaign  Objectives  Assessment  Board  (COAB).  It’s  chaired  by  the  Director  J8  and 
comprised  of  HQ  staff.  Component  liaison  officers,  and  representatives  from  allied/coalition  partner  countries.  The 
COAB  Chair  routinely  briefs  the  CINC,  Coalition  partners,  and  other  planning  boards  in  the  HQ. 

To  support  the  COAB,  the  Assessment  and  Requirements  Division  (CCJ8-AR)  at  CENTCOM  has  developed  a 
Campaign  Analysis  /  Decision  Support  System  (CA/DSS).  The  CA/DSS  methodology  involves  establishing  a  hierarchical 
set  of  objectives  from  the  campaign  (theater-level)  ...  to  the  operational  ...  to  the  tactical.  It  allows  for  the  further 
breakdown  of  tactical-level  objectives  into  military  tasks,  and  measures  of  effectiveness  (MOEs).  Designated  HQ  and 
Component  representatives  enter  objective,  task,  and  MOE  information  from  their  respective  operational  locations.  They 
also  set  importance  factors  for  each  and  make  assessments,  beginning  at  the  MOE  level.  For  military  tasks  with  several 
MOE,  each  MOE's  “rating”  is  weighted  by  its  “importance.”  The  net  assessment  at  the  military  task  level  is  the  “weighted 
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average”  of  the  aggregate  MOE.  This  same  “weighted  average”  algorithm  is  applied  at  each  successively  higher  level  as 
assessments  are  "rolled  up”  to  the  theater  campaign  level. 

In  addition  to  capturing  current  assessments  as  events  occur,  CA/DSS  enables  planners  to  project  when 
objectives/tasks/MOEs  are  expected  to  be  achieved.  Comparisons  of  “current”  vs.  “projected”  states  of  campaign 
progress  will  reveal  where  actual  results  are  either  lagging,  on  track,  or  exceeding  planned  timeframes.  From  these 
aggregate  assessments,  conclusions  can  be  drawn  and  recommendations  made  to  USCINCCENT  and  other  planning 
boards  in  the  HQ  regarding  required  operational  adjustments. 

Modeling  JTF  Level  Command  and  Control  in  JWARS 


Dr.  Dennis  Carroll 

METRON  Corporation 
11911  Freedom  Drive,  Suite  800 
Reston,  VA  20190-5602 
(703)  696-9490;  Fax,  x-9463 
carroll@metsci.com 


Harvey  F.  Graf 
The  MITRE  Corporation 
7515  Colshire  Drive 
McLean,  VA  22102-7508 
(703)  696-9490;  Fax,  x-9463 
graf@mitre.org 


The  Joint  C2  decision  process  involves  coordinated  actions  of  the  Joint  Force  Commander  and  his  Component 
Commander.  An  ongoing  model  development  effort  in  the  Joint  Warfare  System  (JWARS)  model  enables  one  to 
synchronize  a  counteroffensive  operation.  The  underlying  modeling  approach  that  allows  this  to  execute  can  be  extended  to  a 
multitude  of  other  C2  decisions.  The  model  includes  rudimentary  decision-making  with  an  explicit  analytical  assessment  of 
some  situations.  The  purpose  is  to  provide  a  capability  for  complex  integration  of  multi-service  action  into  a  coordinated 
activity.  The  basic  features  include  a  dynamic  command  structure,  where  each  commander  controls  “their”  own  forces.  Each 
commander  acts  according  to  higher-level  guidance,  but  adapts  their  actions  to  respond  to  the  local  situation.  A 
commander’s  decisions  are  made  dynamically  based  on  an  assessment  of  perceived  truth  and  its  effect  on  force  maneuver 
decisions. 

This  presentation  will  discuss  the  JWARS  current  implementation  of  these  concepts,  the  development  path  for  future 
enhancements,  and  the  use  of  these  concepts  in  support  of  campaign  analysis. 


Campaign  Analysis:  Current  NEA  Theater  Missile  Defense  Baseline 

Mr.  Michael  S.  Goodwin 

Joint  National  Integration  Center 
National  Defense  Missile  Agency 
Schriever  AFB,  CO  80912 
(719)  567-9257 
Usaa9786@intf.osd.smil.mil 

The  Joint  National  Integration  Center  (JNIC)  is  conducting  a  study  for  the  32nd  Army  Air  and  Missile  Defense  Command 
(AAMDC)  to  provide  a  campaign-level  assessment  of  current  forces’  and  deliberate  plans’  ability  to  accomplish  assigned  and 
implied  Theater  Missile  Operations  (TMO)  tasks  in  the  North  East  Asia  (NEA).  The  primary  focus  of  the  analysis  is  a 
rigorous  assessment  of  the  32nd  AAMDC ’s  mission  tasks.  The  JNIC  setup  a  realistic  battlefield  simulation  based  on  the 
current  NEA  OPLAN,  current  theater  forces  and  Time  Phased  Force  Deployment  Data  (TPFDD).  The  goal  of  the  project  is 
to  examine  battlefield  inter-relationships  and  determine  strengths  and  weaknesses  in  current  deliberate  plans.  The  JNIC 
worked  collaboratively  with  the  32nd  AAMDC  to  investigate  methods  to  mitigate  any  weaknesses  determined  to  be 
significant.  In  addition  to  the  baselining  of  the  campaign,  the  JNIC  conducted  excursions  to  the  baseline. 

The  JNIC  used  a  mission  -  task  -  modeling  -  results  methodology  consistent  with  the  U.S.  Joint  Forces  Command’s 
(USJFCOM’s)  development  of  the  Universal  Joint  Task  List  (UJTL).  The  analysis  team  examined  the  32nd  AAMDC  mission 
and  assigned  tasks,  and  developed  modeling  inputs  and  desired  outputs  to  investigate  these  four  tasks:  Defended  Asset  List 
(DAL)  Protection,  Active  Defense  Force  Performance,  Attack  Operations  Performance,  General  Consumption  of  Assets. 
Three  study  objectives  anchor  the  methodology.  The  goal  of  the  Proof  of  Principle  objective  is  to  ensure  the  model, 
COMBAT  IV,  is  prepared  to  properly  simulate  the  32nd  AAMDC  project  scenario  battlespace,  and  produce  reasonable 
results.  The  Campaign  Baseline  objective  has  as  a  goal  to  examine  the  baseline  ability  of  currently  assigned  and  apportioned 
theater  forces  to  deny  or  negate  enemy  TBM  operations  and  the  resultant  campaign  level  effects  of  that  afforded  protection. 
The  Threat  Excursions  goal  is  to  determine  the  sensitivity  of  current  baseline  TMD  protection  to  differing  threat  TM 
campaign  courses  of  action.  This  paper  provides  an  update  on  the  JNIC  project  in  support  of  the  32nd  AAMDC. 


118 


Joint  Campaign  Analysis  WG-17 

Operations  Analysis  Supporting  the  Joint  Task  Force 


Ms.  Cindy  Grier 

HQ  USAREUR  Unit  29351 

ATTN:  AEAGS-OR 

APO  AE  09014 

49-6221-57-2169;  Fax,  x-7024 

cindy.grier@cmdgrp.hqusareur.army.mil 


MAJ  Bobbi  Leyes,  USA 

HQ  USAREUR  Unit  29351 

ATTN:  AEAGS-OR 

APO  AE  09014 

49-6221-57-8034;  Fax,  x-7024 

Bobbi.leyes@cmdgrp.hqusareur.army.mil 


As  the  Army  transforms  to  the  Objective  Force,  the  Legacy  Force  continues  to  maintain  its  overmatch  capabilities. 
Although  the  US  Army  Europe  (USAREUR)  is  a  key  component  of  the  Legacy  Force,  it  also  understands  that  it  must 
maintain  trained  and  ready  forces  capable  of  conducting  military  operations  over  the  entire  spectrum.  As  the  USAREUR 
Headquarters  transitions  into  an  Army  Service  Component  Command  (SCC)  and  increases  involvement  in  Joint  and 
Combined  operations,  the  focus  of  the  Operations  Research  /  Systems  Analysis  (ORSA)  Cell  shifts  from  supporting  Base 
Operations  (BASOPS)  analysis  to  supporting  the  Warfighter.  This  change  in  focus  requires  the  operations  research 
community  to  re-look  analytical  support  provided  to  the  operational  and  tactical  levels  of  command.  The  US  European 
Command  (EUCOM)  took  steps  in  this  revolution  by  providing  Operation  Analysis  (OA)  Teams  to  Joint  Task  Forces  (JTF) 
in  the  European  Theater  starting  in  1997.  This  capability  is  now  official  and  part  of  the  EUCOM  Directive  55-11.  This 
document  ensures  that  each  JTF  has  the  required  analytical  resources  to  plan  for  and  execute  its  mission  successfully. 
Similarly,  the  North  Atlantic  Treaty  Organization  (NATO)  established  an  Exploratory  Team  to  examine  the  Operations 
Analysis  support  to  the  Joint  Task  Force  and  Component  Commanders. 

This  paper  focuses  on  the  capabilities  and  products  that  the  OA  team  brings  to  the  fight.  The  platform  to  demonstrate 
the  utility  of  the  team  is  a  series  of  AGILE  LION  exercises  featuring  a  Southern  European  Task  Force  (SETAF)  led  JTF 
deploying  into  Africa  for  a  SSC  and  our  support  to  an  Air  Force  lead  JTF.  The  authors  will  demonstrate  products  already 
developed  and  their  impact  on  the  success  of  the  mission.  Additionally,  they  will  also  offer  their  experiences  and  propose 
suggestions  about  how  the  OA  team  can  integrate  themselves  as  a  key  part  of  the  JTF  staff. 


Logistics  in  an  Theater  Warfight 


Douglas  “Ben”  Herr,  Unisys 

OSD,  PA&E  Simulation  and  Analysis  Center 

1401  Wilson  Blvd.,  Suite  300 

Arlington  VA  22209-2306 

(703)  696-9360;  Fax,  x-9394 

douglas.herr@osd.pentagon.mil 


Tim  Gannon,  GRCI 

OSD,  PA&E  Simulation  and  Analysis  Center 
1401  Wilson  Blvd.,  Suite  300 
Arlington  VA  22209-2306 
(703)  696-9360;  Fax,  x-9394 
timothv.gannon@osd.pentagon.mil 


Most  likely,  conflicts  in  the  future  will  have  the  U.S.  fighting  with  coalition  forces.  In  some  instances,  the  host  nation  in 
the  theater  of  operations  has  agreed  to  provide  logistical  support  to  the  US  military.  Additionally,  the  host  nation  provides 
logistical  support  to  their  own  forces.  What  is  the  impact  on  US  operations  when  host  nation  support  is  degraded,  and  /or 
coalition  forces  cannot  adequately  support  themselves  and  the  US  must  now  provide  their  logistics  support? 

This  briefing  describes  how  the  Simulation  and  Analysis  Center  (SAC)  continues  to  analyze  the  impact  of  logistics  in  a 
theater  warfight.  In  particular,  this  initial  effort  determined  the  potential  impact  of  coalition  force  logistics  requirements  on 
the  US  logistics  infrastructure.  Coalition  logistics  consumption  data  was  estimated  using  Combined  Arms  Support  Center’s 
(CASCOM)  OPLOG  Planner  and  integrated  into  Enhanced  Logistics  Intratheater  Support  Tool  (ELIST).  The  results  show 
the  magnitude  of  support  that  the  US  may  need  to  provide  when  coalition  operations  exceed  their  own  logistics  capability. 

Tuning  Theater  Level  Ground  Attrition  to  Division  Level  Output 

James  Hinch 

OSD/P A&E,  Simulation  and  Analysis  Center 
1401  Wilson  Blvd,  Suite  300 
Arlington,  VA  22209-2306 
703-696-9361;  Fax,  x-9394 
iames.hinch@osd.pentagon.mil 

The  traditional  ground  attrition  methodology  of  the  Joint  Integrated  Contingency  Model  (JICM)  has  1557  input  numbers. 
That  gives  the  user  a  lot  of  control,  but  can  make  it  very  hard  to  select  a  “correct”  set  of  inputs.  The  default  values  were 
chosen  by  subject  matter  experts  to  portray  the  desired  effects  of  many  battlefield  conditions  relative  to  each  other.  But  the 
accuracy  of  the  resulting  output  cannot  be  determined  without  a  standard  for  comparison.  Given  reliable  attrition  numbers 
from  a  known  scenario,  correct  JICM  inputs  should  be  able  to  reproduce  that  standard  closely. 
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This  study  attempted  to  derive  a  set  of  inputs  to  make  JICM’s  theater-level  ground  attrition  match  the  output  from  a 
series  of  division  level  model  simulations.  The  latter  were  much  more  detailed  than  JICM,  and  assumed  to  be  of  sufficiently 
high  fidelity  to  use  as  a  standard.  After  creating  JICM  simulations  of  the  division  level  battles,  the  default  inputs  produced 
very  different  attrition  output  from  the  division  level  model.  Effects  of  changing  various  inputs  then  had  to  be  explored, 
followed  by  attempts  to  minimize  the  error  between  JICM  output  and  the  assumed  standard.  We  considered  JICM  attrition  to 
be  “tuned”  to  the  more  reliable  values  when  further  input  changes  failed  to  reduce  the  error  term. 

Combined  Forces  Command  Amphibious  Analysis  III 

Brian  A.  Hodges 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth  66027-2345 
(913)  684-9207;  Fax,  x-9191 
hodgesb@trac.armv.mil 

The  Combined  Forces  Command  Amphibious  Analysis  III  analyzes  a  branch  plan  of  a  Combined  Forces  Command 
Operation  Plan  (OPLAN)  employing  combined  Naval  and  Marine  Forces.  For  this  analysis,  TRAC  employed  its  own  Vector 
in  Commander  amphibious  modeling  capabilities.  TRAC  also  integrated  analytical  efforts  from  a  number  of  joint  service 
agencies  such  as  US  Transportation  Command's  Military  Traffic  Management  Command  Transportation  Engineering 
Agency,  the  Center  for  Naval  Analysis,  Marine  Corps  Combat  Development  Command,  and  the  Navy's  Mine 
Countermeasures  Squadron  One  to  complete  the  effort.  The  presentation  will  highlight  the  amphibious  operations  modeling 
approach,  the  study  methodology,  study  findings,  and  analytical  insights. 

Conventional  Forces  Database  (CFDB)  presentation  /  demo  / feedback 

Mr.  R.  Eric  Johnson 

Joint  Data  Support  /  Unisys  Corp. 

1225  Jefferson  Davis  Hwy  Ste  200 
Arlington,  VA  22202 
(703)  414-1924;  Fax,  x-8114 
eric .  i  ohnson  @  osd .  pentagon .  mi  1 

The  Conventional  Forces  Database  (CFDB)  is  a  semi-annual  product  of  Joint  Data  Support  (JDS).  [JDS  is  a  major 
component  of  the  Joint  Analytic  Model  Improvement  Program  (JAMIP)  under  the  sponsorship  of  OSD  PA&E  with 
funding  from  the  Joint  Staff  (J-8).]  CFDB  consists  of  conventional  forces,  units,  equipment,  personnel,  and  other  data  for 
all  the  U.S.  Armed  Services,  including  the  U.S.  Coast  Guard,  for  the  current  year.  Packaged  with  CFDB  is  a  Force 
Analyzer  toolkit,  which  can  perform  user-friendly  data  queries  of  various  types.  Over  50  customers,  DoD-wide,  make  use 
of  CFDB  for  a  variety  of  purposes. 

There  will  be  a  short  introductory  brief,  a  demonstration  of  CFDB,  and  opportunities  to  both  be  included  on  the  CFDB 
distribution  list  and  to  feed  back  any  recommended  improvements  or  enhancements  to  the  product. 

Sudden  Storm:  Campaign  Analysis  and  Combat  System  Order  of  Priority 

MAJ  Karl  O.  Schwartz.  USA 

Center  for  Army  Analysis 

6001  Goethals  Road,  Fort  Bel  voir,  VA  22060 

(703)  806-5611;  Fax,  x-5727,  Schwartz@caa.armv.mil 

As  U.S.  forces  prepare  for  the  21st  Century,  the  need  for  joint  modeling  and  simulation  increases.  With  limited  assets 
deployed  forward,  the  correct  force  packaging  becomes  increasingly  important,  especially  in  the  joint  arena.  This 
presentation  covers  the  initial  phases  of  a  major  theater  of  war  where  the  defense  and  no  penetration  line  are  critical.  Each 
supporting  asset  (Army,  Navy,  &  Air  Force)  is  reviewed  as  to  its  criticality  in  the  defense  and  holding  of  the  no  penetration 
line.  The  analysis  provides  a  first  cut  cause  and  effect  of  the  systems  and  a  case  for  justification  and  order  of  priority  for 
each. 
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Joint  Campaign  Analysis  Process 

Mr.  James  R.  Shelby.  SAIC 
1710  SAIC  Drive 
McLean,  VA  22102 
(703)  676-5229;  Fax,  x-2344 
iames.r.shelby@saic.com 

The  Quadrennial  Defense  Review  was  the  occasion  for  the  detailed  examination  of  the  U.S.  National  Military 
Strategy.  Among  the  tools  used  in  the  process  were  computer  models  simulating  joint  combat  at  the  campaign  level.  This 
presentation  covers  the  work  performed  by  the  Navy  staff  (OPNAV  816)  in  coordination  and  cooperation  with  OSD 
PA&E  in  the  analysis  of  a  large  scale,  near-peer  scenario.  It  covers  the  analysis  process;  model  selection,  scenario 
interpretation,  data  collection  and  validation,  and  the  process  of  feeding  the  inputs  into  formats  that  the  models  could 
transform  into  actions  (the  campaign).  Detailed  are  those  actions  specific  to  the  Integrated  Theater  Engagement  Model 
(ITEM),  the  only  model  that  was  common  between  N816  and  OSD.  OSD  PA&E  also  used  TACWAR  and  JICIM  to 
model  the  campaign,  and  the  process  of  comparing  the  results  is  also  discussed. 

TACWAR  Attrition  Study  Issues 

Mr.  Don  L.  Smith, 

OSD  PA&E  Simulation  and  Analysis  Center 
1401  Wilson  Blvd,  Suite  300 
Arlington,  VA  22209-2306 
(703)  696-9360;  Fax,  x-9394 
don. smith  @osd. pentagon.mil 

TACWAR  is  a  theater  level  campaign  model  used  by  many  organizations  including  OSD,  the  Joint  Staff  and  the  CINCs. 
The  heart  of  any  campaign  model  is  the  attrition  element  used  to  determine  casualties  incurred  by  each  side  during  the  fight. 
Upon  comparison  of  similar  campaigns  over  time,  a  series  of  questions  arose  concerning  TACWAR  attrition  evaluations, 
COSAGE  valuations  and  the  Anti-Potential  Potential  algorithm. 

This  briefing  describes  an  examination  of  the  variable  (PWSF)  depicting  the  composition  of  weapons  in  the  ground 
battle  within  TACWAR,  the  interface  of  COSAGE  and  TACWAR  valuations,  and  the  APP  methodology. 


Joint  Data  Support 


Dr.  James  G.  Stevens,  GS-15 
OSD  OD/PA&E  (JDS) 

1225  Jefferson  Davis  Hwy  Ste  200 
Arlington,  VA  22202 
(703)  414-1940;  Fax,  x-8114 
iames.stevens@osd.pentagon.mil 


Mr.  R.  Eric  Johnson 

Joint  Data  Support  /  Unisys  Corp. 

1225  Jefferson  Davis  Hwy  Ste  200 

Arlington,  VA  22202 

(703)  414-1924;  Fax,  x-8114 

eric.iohnson@osd.pentagon.mil 


Joint  Data  Support  (JDS)  is  a  component  of  the  Joint  Analytic  Model  Improvement  Program  (JAMIP),  under  the 
administration  of  the  Office  of  the  Secretary  of  Defense  (Program  Analysis  and  Evaluation),  with  funding  from  the  Joint 
Staff  (J-8).  The  charter  of  JDS  is  to  provide  and  manage  data  for  DoD  analytical  studies  along  a  broad  customer  base, 
including  both  studies  using  “JAMIP”  simulations  (MIDAS,  TACWAR,  ITEM,  ELIST,  VIC,  and  EADSIM),  and  those  using 
other  decision  support  processes  (e.g.,  the  DYNAMIC  COMMITMENT  seminar  wargame).  The  charter  of  JDS  also  includes 
support  for  development  and  fielding  of  the  Joint  Warfare  System  (JWARS). 

JDS  operates  according  to  a  rigorous  yet  flexible  Study  Support  Process.  This  brief  will  provide  details  of  that  process, 
including  JDS  principles  and  challenges.  There  will  be  several  recent  examples  of  JDS-provided  data  support.  A  large 
portion  of  this  brief  will  cover  data  support  for  the  development  and  fielding  of  JWARS. 
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Joint  and  Combined  Warfare  Analysis  at  Headquarters  USCINCPAC 


Mr.  Arnie  Warshawskv 

Commander  in  Chief,  USCINCPAC 
Attn:  J081  (Mr.  Warshawsky) 

Box  64028 

Camp  H.  M.  Smith,  HI  96861-4028 
(808)  477-6390  x  2606;  Fax  x-0245 
a  warshawskv  @  vic-info.org 


Mr.  Don  Theune,  Northrop-Grumman-IT 
Commander  in  Chief,  USCINCPAC 
Attn:  J081  (Mr.  Theune) 

Box  64028 

Camp  H.M.  Smith,  Hi  96861-4028 
(808)  477-6390  x  2604;  Fax  x-0245 
dtheune@vic-info.ore 


The  USCINCPAC  Research  and  Analysis  Division  (J081)  is  working  on  an  extensive  study  in  support  of  the 
USCINCPAC  staff.  Numerous  collaborative  agencies  and  staffs  throughout  the  Department  of  Defense  have  aided  this  study 
analysis  of  Joint  and  Combined  Warfare.  We  are  using  the  Integrated  Theater  Engagement  Model  (ITEM)  and  the  Extended 
Air  Defense  Simulation  (EADSIM)  for  this  analysis.  Specifically,  we  use  ITEM  to  support  the  assessment  of  operations 
plans  and  alternatives  in  the  areas  of  Maritime  Interdiction,  Air  Superiority,  Ballistic  Missile  Employment,  and  Amphibious 
Operations.  EADSIM  is  used  to  investigate  interactions  in  greater  detail  and  to  provide  data  resolution  to  ITEM’S  integrated 
theater  environment.  This  presentation  will  provide  an  update  to  the  collaborative  analysis  methodology,  modeling 
techniques,  scenario  assumptions,  and  study  plan  details,  and  will  highlight  several  preliminary  results  of  the  study  as  well  as 
lessons  learned  in  performing  collaborative  assessments. 

From  the  2001  QDR  to  the  2002  Joint  Strategic  Capabilities  Plan 

LtCol  Kirk  A.  Yost,  USAF  LtCol  Wallace  “Skip”  Langbehn,  USAF 

OUSD  for  Policy,  Strategy  Division  JCS  J-8/Forces  Division 

2900  Defense  Pentagon  Washington,  DC  203 1 8-8000 

Washington,  DC  20301-2900  703-614-9751;  Fax,  x-4701 

703-614-0421;  Fax,  x-0400  Skip.langbehn@is.pentagon.mil 

kirk.yost@osd.pentagon.mil 

The  2001  Quadrennial  Defense  Review  (QDR)  outlined  a  broad  strategic  framework  for  the  Department  of  Defense.  A 
considerable  amount  of  analysis  will  be  required  over  the  next  several  years  to  interpret,  refine,  and  implement  the 
framework  outlined  in  the  QDR.  This  presentation  will  present  an  overview  of  the  new  Defense  strategy,  and  discuss  the 
analytical  challenges  in  translating  those  concepts  to  size  and  shape  U.S.  conventional  forces.  In  particular,  the  briefing  will 
address  some  of  the  issues  in  using  the  new  strategy  to  do  force  apportionment  in  the  Joint  Strategic  Capabilities  Plan  (JSCP). 
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Chair:  Maj.  David  Lyle,  AFLMA 
Co-chairs:  Lt  Col  Robert  T.  Brigantic,  USTRANSCOM/J5-AI 
Kelly  Lauritzen,  USAREUR 
Advisor:  Robert  Drash,  GRCI 

Bell  Hall  19B 


The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 


Focused  Logistics  Wargame  01  ( FLOW  01)  Intratheater  Sustainment  Lift  Analysis 


Charles  W.  Barker  III,  Tammy  Carklin,  Dorothy  Saks 

Systems  Planning  &  Analysis 

2000  N.  Beauregard  St  400 

Alexandria,  VA  223 1 1 

703-931-3500,  cbarker@spa-inc.net 


Carl  Lawrimore  and  Kelly  Musaic 
HQ,  MTMC-TEA 
Newport  News,  VA 
757-599-1111 

LawrimoC  @tea-emh  1  .army.mil 


FLOW  01  represented  the  first  concerted  effort  to  gather  sustainment,  operational  planning  factors,  and  assumptions 
from  joint  and  combined  force  participants  for  the  examination  of  logistics  interoperability  and  interdependency  issues.  The 
portrayal  of  these  forces  within  a  common  context  provided  considerable  insights  into  distribution  analysis  and  opportunities 
for  examination  of  logistics  footprint  reduction  possibilities,  a  major  FLOW  01  objective.  This  was  most  clearly  seen  during 
a  particularly  stressing  NEA  scenario,  adapted  from  the  Mobility  Requirements  Study  05  (MRS  05).  The  scenario  combined 
the  tactical  locations  and  combat  intensities  of  major  force  elements,  modified  to  reflect  the  participating  elements  of 
coalition  partners,  and  added  in  unique  logistics  planning  factors,  support  relationships,  and  doctrinal  assumptions  of  the 
contributing  forces.  The  dynamically  changing  sustainment  requirements  were  fed  into  intratheater  distribution  and  lift 
models  to  assess  the  level  of  transportation  sufficiency  in  meeting  sustainment  requirements,  the  results  then  integrated  into  a 
theater  level  campaign  simulation  to  permit  high  level  examination  of  joint  and  combined  operational  level  logistics  and 
support  issues. 


Interim  Division  Deployment  Analysis  Methodology 

Jennifer  Casto 

TRADOC  Analysis  Center 

255  Sedgwick  Avenue,  Fort  Leavenworth,  KS  66027-2345 
(913)  684-9183,  FAX:  (913)  684-9189,  castoi  @ trac.armv.mil 

This  paper  focuses  on  the  deployment  analysis  conducted  in  support  of  the  operational  and  organizational  (O&O) 
concept  development  of  the  new  Interim  Division.  Deployment  analysis  has  been  a  key  component  in  the  evaluation  of 
alternative  Interim  Division  designs.  The  analysis  compared  the  deployability  of  different  force  structures,  including  various 
base  cases,  and  provided  a  set  of  reference  points  in  moving  towards  the  Army  vision  of  deploying  a  division  in  120  hours. 
This  analysis  provided  insight  to  decision-makers  regarding  deployment  challenges  associated  with  each  division  design. 

The  deployment  analysis  was  based  on  a  TRADOC-approved  scenario  and  derived  from  Defense  Planning  Guidance. 
We  used  the  Joint  Flow  and  Analysis  System  for  Transportation  (JFAST),  a  U.S.  Transportation  Command  model,  to  model 
the  force  flow  and  provide  Interim  Division  closure  estimates.  This  presentation  will  focus  on  methodology,  end-to-end 
modeling  challenges,  and  the  resulting  parametric  analysis. 

Improving  Deployment  Velocity  at  the  SPOD:  A  Force  Mobility  Characteristics  Analysis 

Michael  F.  Cochrane.  Ph.D. 

Military  Traffic  Management  Command 
Transportation  Engineering  Agency 
Voice:  (757)  599-1628,  FAX:  (240)  209-8206 
Cochranm@tea-emhl.armv.mil 

This  study  hypothesizes  that  100  percent  mobile  and  roadable  combat  units  will  be  more  deployable  than  conventional 
units,  even  if  their  deployment  footprint  is  increased  by  adding  more  organic  cargo  vehicles.  A  100  percent  mobile  unit  will 
be  able  to  clear  a  sea-  or  airport  of  debarkation  on  its  own,  eliminating  a  large  number  of  transportation  line  haul 
requirements,  thereby  improving  system  flow.  In  this  research-in-progress,  designed  experimentation  is  used  to  investigate 
the  relative  importance  of  SPOD  resources  and  infrastructure,  as  well  as  the  mobility  characteristics  of  the  deploying  force.  A 
stochastic  simulation  model  of  port  activity,  PORTSIM,  is  used  to  simulate  the  deployment  of  a  notional  division-sized  force. 
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Unit  Equipment  Files  are  modified  to  model  the  effect  of  a  theoretical,  all-wheeled,  self-mobile  force.  It  is  expected  that 
experimentation  will  identify  the  most  significant  factors  in  port  throughput  as  well  as  provide  force  design  criteria.  The 
results  of  this  research  is  expected  to  show  that  at  least  as  much  emphasis  be  placed  on  designing  forces  for  improved  self¬ 
deployability  as  is  placed  on  strategic  lift  or  deployment  infrastructure. 

A  Tabu  Search  Algorithm  for  Solving  Theater  Distribution  Vehicle  Routing  and  Scheduling 
Problems 


MAJ  John  Crino 

Air  Force  Institute  of  Technology 

W.P.A.F.B.,  OH  45433 

937-255-6565  ext  4307,  John.Crino@afit.edu 


Dr.  James  T.  Moore 

Air  Force  Institute  of  Technology 

W.P.A.F.B.,  OH  45433 

937-255-6565  ext  4337,  James.Moore@afit.edu 


Military  logisticians  lack  an  automated  tool  that  prescribes  favorable  vehicle  routes  and  schedules  for  distribution  of 
goods  and  services  within  a  theater  of  operation.  This  presentation  outlines  a  robust  and  flexible  generalized  theater 
distribution  algorithm  that  prescribes  the  routing  and  scheduling  of  multi-modal  theater  transportation  assets  that  provide 
economically  efficient  time  definite  delivery  of  goods  to  customers.  The  algorithm  solves  theater  distribution  problems  such 
that  vehicles  make  multiple  trips  and  customers  are  serviced  multiple  times  per  planning  horizon,  hubs  are  part  of  the 
distribution  network,  and  throughput  constraints  are  considered.  The  algorithm  utilizes  the  tabu  search  technique,  constraint 
programming,  and  group  theory. 


Assessing  Effects  of  Enhanced  Fidelity  for  Ground  Vehicle  Mobility  in  Combat  Models 


MAJ  Simon  R.  Goerqer 

Naval  Postgraduate  School 
Monterey,  CA  93943-5118 
831-656-3733,  FAX:  831-656  4083 
Srgoerge@nps.navy.mil 


Dr.  Niki  C.  Deliman 
USAERDC 

Vicksburg,  MS  39180-6199 
601-634-3369,  FAX:  601-634-2794 
Niki.C.Deliman@erdc.usace.armv.mil 


David  R.  Durda 

USA  TRADOC  Analysis  Ctr  -  WSMR 
WSMR,  NM  88002-5502 
Ph:  505-678-3217 
FAX:  505-678-5104 


As  computer  systems  exhibit  greater  computing  power,  they  provide  combat  model  developers  the  capabilities  to 
enhance  the  fidelity  of  their  simulations  by  improving  the  fidelity  of  underlying  algorithms.  Movement,  such  as  ground 
vehicle  movement,  is  one  of  the  basic  battlefield  functions  and  is  portrayed  at  differing  levels  of  fidelity  across  M&S. 
Ground  vehicle  movement  is  limited  by  the  terrain/environmental  factors  present  in  reality,  but  this  fact  is  not  necessarily 
reflected  in  current  simulations.  The  need  to  account  for  such  effects  has  been  acknowledged  by  the  community  and  is  being 
incorporated  in  developing  simulations.  As  simulation  fidelity  is  enhanced,  however,  it  is  also  important  to  address  the 
question  of  what  increased  or  decreased  fidelity  representation  buys  the  user/analyst. 

This  paper  will  address  effects  of  improving  ground  vehicle  mobility  representation  in  entity-level  M&S  by 
incorporating  mobility  limiters,  utilizing  the  recent  integration  of  the  standard  mobility  application  programmers  interface, 
STNDMob  API,  with  COMBAT™.  The  development  and  integration  were  conducted  largely  by  the  US  Army  Engineer 
Research  and  Development  Center  and  the  US  Army  TRADOC  Analysis  Center  -  White  Sands  Missile  Range. 
COMBAT™  is  the  Army’s  next-generation  brigade  and  below  entity  level  analytical  model.  The  standard  mobility 
application  programmers  interface,  STNDMob  API,  allows  entity  level  models  to  use  terrain  limited  speed  factors  and  is 
based  on  the  Army’s  standard  mobility  model,  NATO  Reference  Mobility  Model  (NRMM).  This  integration  has  revealed 
some  potential  impacts  on  simulation  outcomes  resulting  from  dynamically  limiting  the  speed  of  vehicles  and  restricting 
areas  of  operation  based  on  environmental  conditions  versus  utilizing  command  ordered  or  static  speeds  and  will  form  the 
basis  for  the  study. 


Using  Mobility  Analysis  in  Aircraft  Design 


Mr.  William  Carolan 

The  Boeing  Company  (C076-665) 

2401  E.  Wardlow  Long  Beach,  CA  90807 
Phone  562-982-9871,  Fax  562-496-5038 
William.i.carolan@boeing.com 


Gordon  Gruffub 

The  Boeing  Company  (C076-665) 

2401  E.  Wardlow  Long  Beach,  CA  90807 
Phone  562-593-7137,  Fax  562-496-5038 
Gordon.griffin@boeing.com 


Design  engineers  and  operations  analysts  are  seldom  in  the  same  room  when  military  weapon  systems  requirements  are 
being  discussed.  Any  product  desiring  both  high  utility  and  low  cost  can  only  be  assured  if  the  tradeoffs  between  utility  and 
cost  are  made  up  front  before  too  much  time  and  money  is  invested. 
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This  presentation  presents  an  application  of  designing  a  future  airlifter  that  links  design  to  military  utility,  balanced  with 
the  expected  cost  of  these  designs  using  a  CAIV  approach.  Two  models  used  in  this  study  are  the  Airlift  Loading  Model 
(ALM)  and  Mobility  Simulation  Model  (MobSim). 

A  Hybrid  TABU  Search/Set  Partitioning  Approach  to  Tanker  Crew  Scheduling 

Capt  Todd  E.  Combs,  Dr.  James  T.  Moore 

AFIT/ENS,  2950  P  St  AFIT/ENS,  2950  P  St 

WPAFB,  OH  45433-7765  WPAFB,  OH  45433-7765 

937-255-6565  x  4308/  937-656-4943  (FAX)  937-255-6565  x  4337/  937-656-4943  (FAX) 

todd.combs@afit.edu  iames.moore@afit.edu 

Aerial  refueling  is  a  crucial  component  of  modern  day  operations.  A  vital  part  of  this  refueling  process  is  the  individual 
tanker  crews.  Constrained  by  the  number  of  crews  available,  the  USAF  must  find  ways  to  schedule  them  efficiently. 

This  paper  details  solving  the  tanker  crew  scheduling  problem  with  a  hybrid  tabu  search/set  partitioning  optimizer.  We 
show  the  synergistic  use  of  the  two  approaches.  The  tabu  search  metaheuristic  acts  as  a  column  generator  for  the  set 
partitioning  optimizer,  while  the  set  partitioning  optimizer  provides  a  vocabulary  building  mechanism  for  the  tabu  search. 

We  show  how  the  model  may  be  used  as  an  analytical  tool,  as  well  as  an  operational  scheduler.  Statistical  results  show 
the  increased  performance  of  the  hybrid  over  the  existing  USAF  tool  and  the  tabu  search  working  alone.  The  results  also 
show  how  problem  characteristics  affect  the  solution  process. 

The  Brigade  Assault  Bridging  Analysis  (BABA)  Study 

MAJ  Patrick  J.  Delaney 

Center  for  Army  Analysis 
6001  Goethals  Road 
Fort  Belvoir,  VA  22060-5230 
703.806.5618 

fax:  703.806.5726  or  703.806.5727 
delanev@caa.armv.mil 

In  realigning  the  Force  Structure,  rigorous  and  comparative  analysis  will  be  the  hallmark  to  input  in  the  decision  making 
process.  Systems  being  considered  for  acquisition  will  have  to  illustrate  their  worth  to  the  Army  before  investments  can  be 
made.  Recently,  the  Vice  Chief  Staff  of  the  Army  asked  ODCSOPS  to  evaluate  the  Wolverine  against  the  Armored  Vehicle- 
Launched  Bridge  when  considering  Force  Structure  and  Cost.  ODCSOPS  asked  CAA  to  assist  in  the  analysis.  The  purpose 
of  the  Brigade 

Assault  Bridging  Analysis  (BABA)  Study  was  to  perform  the  comparative  analysis  of  the  capabilities  of  the  AVLB 
against  the  Wolverine  in  a  worst-case  scenario.  Given  the  extensive  requirement  for  bridging  assets  in  Korea,  CAA  used  a 
Northeast  Asia  scenario.  CAA  considered  the  maintenance  readiness,  survivability  and  gap  crossing  capabilities  in 
developing  the  model.  The  result  of  this  study  was  a  tool  that  allowed  Decision  makers  to  assess  their  particular  risk  pattern 
and  see  the  impact  on  Operational  Planning  in  a  Northeast  Asia  scenario.  This,  ultimately,  provided  input  to  the  greater 
Force  Structure  and  Capital  Investment  analysis  that  ODCSOPS  provided  to  the  Vice  Chief  of  Staff. 

Analysis  of  Physical  Distribution  Operations  in  Maneuver  Support  Organizations 

MAJ  Gregory  H.  Graves 

HQ  USACASCOM,  3901  A  Ave.,  Suite  220 
Fort  Lee,  VA  23801 
(804)734-0610,  FAX  (804)734-0336 
gravesg@lee.armv.mil 

As  the  Army  transitions  to  a  distribution-based  logistical  support  system,  the  criticality  of  accurately  designing  and 
resourcing  logistics  units  has  become  evident  at  the  highest  levels  of  leadership  in  the  logistics  community.  Units  that 
reconfigure  or  transship  cargo  act  as  nodes  in  the  distribution  system  and  are  of  primary  importance  in  this  effort.  Analysts  in 
the  Army’s  Combined  Arms  Support  Command  (CASCOM)  have  been  actively  engaged  in  analyzing  these  units  and  are 
developing  analysis  tools  to  aid  in  the  combat  developments  process.  The  Army’s  Deputy  Chief  of  Staff  for  Logistics 
sponsored  CASCOM ’s  Container/Materials  Handling  Equipment  (CMHE)  Study  as  an  initial  step  in  improving  the 
resourcing  of  these  units. 

The  Analysis  of  Physical  Distribution  Operations  in  Maneuver  Support  Organizations  study  effort  is  exploiting  the 
lessons  learned  and  tools  developed  during  the  CMHE  Study.  Process  maps  to  document  operational  methods  within  units 
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serve  as  the  basis  for  deterministic  analysis  tools  and  simulation  models  developed  using  Arena.  This  presentation  shows 
refinements  made  to  the  suite  of  decision  support  tools  developed  during  the  CMHE  Study  and  illustrates  the  methodology 
used  to  employ  them  in  the  combat  developments  process  for  distribution  units.  Interim  results  comparing  deterministic  and 
simulation  analysis  are  also  presented. 

Manpower  Transportation  Requirements  Determination 

1  Lt  Sara  E.  Grossman 

200  Beasley  Drive,  Suite  100 
Ft.  Detrick,  MD  21702-5029 
717-878-3138,  Fax:  717-878-2125 
Sara.grossman@pentagon.af.mil 

Time  Phased  Force  Deployment  Data  (TPFDD)  identifies  assigned,  augmentation,  and  supporting  forces  to  be  deployed 
to  the  area  of  operations  (JOPES,  Vol  I).  Ideally,  this  information  serves  as  a  record  of  the  count  of  manpower  deployment 
requirements.  In  the  case  of  Operation  Enduring  Freedom,  the  Air  Force  is  using  this  data  to  help  determine  its  requirement 
for  deploying  manpower.  Alternatively,  the  deployed  personnel  data  gives  the  AF  a  record  of  personnel  at  the  deployed 
location,  counted  as  they  arrive  in  theater.  Analysis  shows  the  deployment  requirements  as  listed  in  the  TPFDD  do  not  align 
with  the  deployed  personnel.  Specifically,  fewer  troops  required  transportation  to  the  theater  of  operations  than  were 
requested  by  the  CINC  in  the  TPFDD,  which  is  essentially  a  transportation  document.  This  analysis  illustrates  that  pure 
TPFDD  numbers  are  potentially  overstated,  and  should  be  used  only  with  discretion  for  simulations,  studies,  and  analyses.  In 
addition,  we  offer  our  own  process  for  assessing  the  TPFDD  and  producing  a  more  accurate  statement  of  the  manpower 
transportation  requirement. 

The  Effects  of  Alternate  Performance  Criteria  on  the  Composition  of  Air  Transportable  Spare  Parts 
Kits 

Lt  Col  Alan  W.  Johnson,  USAF  and  lLt  Volkan  M.  Buyukacar,  Turkish  Air  Force 
Department  of  Mathematical  Sciences 
West  Point,  NY,  10996 
(845)938-7148 
aa2895@USMA.edu 


History  proves  that  for  simultaneous  deployment  of  forces  for  large-scale  operations,  the  demand  for  airlift  soon  exceeds 
its  capacity.  Our  research  investigates  reducing  Readiness  Spares  Packages  (RSP)  sizes  deployed  for  Air  Force  Squadrons  by 
adding  airlift  criteria  -  item  cost,  weight,  and  volume  -  into  the  RSP  selection  process  (extending  the  results  by  Peterson, 
King,  and  Slay).  We  evaluated  our  method  using  an  experimental  design  based  on  the  USAF  Aircraft  Sustainability  Model 
and  F-16,  B-52,  and  KC-135  aircraft  RSPs.  The  experimental  results  show  that  RSP  sizes  can  be  reduced,  but  typically  at  a 
high  increase  in  cost.  However,  in  some  cases  the  three  criteria  used  together  achieved  smaller,  cheaper  RSPs  than  the 
developed  via  the  current  USAF  approach  (using  only  cost-based  analysis).  These  results  suggest  that  this  method  should  be 
adopted  for  the  RSP  selection  process  to  enable  cost  vs.  airlift  requirement  tradeoffs,  and  to  achieve  cost  reductions  on 
selected  RSPs. 


The  Development  and  Testing  of  a  Mathematical  Model  for  Prepositioning  Studies 


Lt  Daniel  Johnstone 

Air  Force  Institute  of  Technology 
Department  of  Operational  Sciences 
2950  P  Street,  Building  640 
Wright-Patterson  AFB,  OH  45433-7765 


Lt  Col  Raymond  Hill 
Air  Force  Institute  of  Technology 
Department  of  Operational  Sciences 
2950  P  Street,  Building  640 
Wright-Patterson  AFB,  OH  45433-7765 


The  Air  Force’s  ability  to  deploy,  employ,  and  sustain  operations  in  forward  locations  is  a  fundamental  key  to  mission 
success.  An  integral  part  of  this  strategy  is  equipment  pre-positioning,  to  include:  vehicles,  aircraft  support,  consumable 
inventory,  and  munitions.  This  study  focuses  on  defining  and  developing  models  to  aid  decision  makers  with  the  afloat 
prepositioning  and  deployment  of  munitions,  in  an  effort  to  ensure  that  the  right  weapons  are  available  when,  and  where 
needed.  This  research  places  a  particular  focus  on  the  strategic,  global  prepositioning  of  the  Air  Force’s  Afloat  Pre¬ 
positioning  Fleet  (APF)  in  an  effort  to  minimize  the  overall  response  time  involved  with  offloading  these  ships  and 
transporting  their  cargo  to  the  intended  point  of  use. 
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The  model  developed  in  this  study  is  a  mixed  integer  program  that  was  implemented  using  the  General  Algebraic 
Modeling  System  (GAMS).  The  model  considers  the  various  aspects  of  pre-positioning  (forward  operating  locations, 
Standard  Air  Munitions  Packages,  and  the  APF)  in  order  to  optimally  locate,  and  configure  each  APF  ship.  In  addition,  the 
model  considers  the  movement  of  munitions  from  land-based  forward  support  locations.  The  methodology  for  this  model 
was  tested  and  verified  using  precision-guided  munitions  data  for  a  number  of  scenarios. 

In  this  presentation,  we  present  some  background  information  on  pre-positioning  and  its  increased  attention  in  military 
analysis,  the  development  and  testing  of  our  mixed  integer  programming  model,  and  analysis  results. 

Evaluation  of  Combat  Service  Support  Logistics  Concepts  for  Supplying  a  USMC  Regimental  Task 
Force 

Capt  Thomas  A.  Lenhardt,  USMC 
USJFCOM,  J9 

1562  Mitscher  Ave,  Suite  200,  Norfolk,  VA  23551-2488 

Tel:  757-836-3954;  FAX:  757-836-2885,  Lenhardtt@ie.ifcom.mil 

One  of  the  primary  responsibilities  of  a  Marine  Corps  Combat  Service  Support  Element  (CSSE)  is  to  provide  water,  fuel, 
and  ammunition  requirements  for  the  primary  task  forces  and  other  Marine  Expeditionary  Force  (MEF)  elements.  This  thesis 
evaluates  existing  and  proposed  concepts  on  how  to  best  use  the  CSSE  resources  of  a  Force  Service  Support  Group  to 
transport  supplies  to  Regimental  Combat  Teams  over  constrained  networks  with  time  constraints.  A  model  was  developed 
that  optimizes  the  use  of  resources,  assets,  and  network  routes.  The  model  first  solves  a  capacitated  vehicle  routing  problem, 
where  a  set  of  customers  has  to  be  served  by  a  fleet  of  vehicles  within  a  certain  time.  The  stochastic  aspects  of  the  problem 
are  modeled  through  the  use  of  a  discrete  event  simulation  that  uses  the  results  of  the  optimization  model.  The  optimization 
model  goes  beyond  the  traditional  routing  problem  by  accounting  for  special  features  such  as  vehicle  capacity  for  each 
commodity  and  cargo  incompatibility  (e.g.  fuel  and  ammunition).  The  model  includes  both  optimization  of  routes  and 
simulation  of  stochastic  elements.  As  a  result,  this  thesis  establishes  a  basis  for  future  studies  involved  with  modeling  new 
concepts  in  Combat  Service  Support. 

Designing  Air  Mobility  Command's  Channel  Route  Network:  A  Composite  Variable  Formulation 

2LT  Chris  Nielsen,  USAF  Maj  Andy  Armacost,  USAF 

MIT/Draper  Laboratory  HQ  USAFA/DFM 

555  Technology  Square,  MS3F,  Cambridge,  M A  02138  2354  Fairchild  Dr,  Rm  6H 128,  USAF  Academy,  CO  80840 

Ph:  617.258.2367;  Fax:  617.258.1799  Ph:  719.333.8476;  Fax:  719.333.9715 

Email:  cnielsen@mit.edu  Email:  Andv.Armacost@usafa.af.mil 

A  large  number  of  the  daily  missions  that  the  TACC  at  AMC  must  schedule  are  channel  route  missions.  Currently,  the 
channel  route  scheduling  process  is  largely  manual.  At  the  beginning  of  each  month,  planners  must  create  a  30-day, 
operational  level  schedule  that  contains  enough  aircraft  missions  to  move  all  the  channel  cargo  within  the  system.  The 
schedule  must  specify  the  aircraft  type,  timing,  and  routing  and  adhere  to  all  operational  rules  associated  with  the 
aircrews/bases. 

We  formulate  the  problem  as  a  network  design  problem.  Our  early  research  focused  on  using  a  traditional  path 
formulation  in  conjunction  with  column  generation  to  create  additional  cargo  paths  and  aircraft  routes  on  the  fly.  However, 
as  a  result  of  the  large  planning  horizon,  this  approach  lacked  to  ability  to  satisfactorily  model  the  real  world  system  and 
yielded  undesirable  solve  times.  The  long  solves  times  were  attributed  to  a  weak  LP  relaxation.  To  address  these  drawbacks, 
we  formulate  the  problem  using  composite  variables.  This  approach  led  to  an  equivalent  formulation  with  fewer  functional 
constraints  and  a  decreased  number  of  decision  variables.  Most  important,  the  composite  variable  formulation  has  tight  LP 
relaxations,  which  significantly  reduces  the  time  required  to  solve  the  model. 

Modeling  Cadet  In-Processing  Procedures  at  the  USMA 

Major  Michael  Nowatkowski 

USMA,  Mahan  Hall,  room  A06 

Department  of  Systems  Engineering,  West  Point,  NY  10996 
(845)938-2668  DSN  688-2668 

Each  year  in  June,  roughly  1,200  students  arrive  at  the  United  States  Military  Academy  (USMA)  to  begin  their  transition 
from  civilians  and  enlisted  soldiers  into  cadets  and  future  officers.  The  first  hurtle  that  all  new  cadets  must  jump  is  the 
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completion  of  their  first  day  called  Reception  Day  (R-Day).  During  R-Day,  new  cadets  spend  most  of  their  morning  in¬ 
processing. 

R-Day  planners  requested  that  we  create  a  simulation  model  in  order  to  test  the  effects  that  changes  would  have  on  the 
in-processing  process.  The  planners  want  to  minimize  the  time  it  takes  a  new  cadet  to  get  through  the  system  with  a 
minimum  numbers  of  employees  manning  the  stations.  They  also  expressed  a  desire  to  reduce  the  total  time  that  the  system 
is  in  operation.  In  order  to  create  this  model  we  used  a  systematic  approach  to  problem  solving  that  ensured  we  produced  an 
accurate  and  effective  model.  Through  the  use  of  stakeholder  analysis  we  determined  the  specific  objectives  of  our  clients. 
Using  these  objectives,  it  was  possible  to  use  the  simulation  model  to  conduct  a  thorough  statistical  analysis  of  the  model  and 
the  alternatives.  Specifically,  the  use  of  Design  of  Experiment  (DOE)  and  experimental  design  processes  allowed  us  to  test  if 
proposed  changes  to  the  base  model  had  a  statistically  significant  effect  on  the  objective  values. 


Interim  Brigade  Combat  Team  (IBCT)  Air  Mobility  Deployment  Analysis 


Ms.  Karvl  Paradise 

US  Transportation  Command 

Plans  and  Policy  Directorate  (J5-AI) 

508  Scott  Drive 

Scott  AFB,  IL  62225 

Ph:  618-229-1463,  FAX:  618-256-6877 

Karyl.paradise@hq.transcom.mil 


Lt  Col  Robert  T.  Brigantic 

US  Transportation  Command 

Plans  and  Policy  Directorate  (J5-AI) 

508  Scott  Drive 

Scott  AFB,  EL  62225 

Ph:  618-229-1459,  FAX:  618-256-6877 

Robert.brigantic@hq.transcom.mil 


This  briefing  presents  an  overview  of  the  methodology  used  to  conduct  an  analysis  of  the  Air  Force’s  capability 
to  deploy  an  Army  Interim  Brigade  Combat  Team  (IBCT).  The  briefing  provides  background  on  the  Army’s  vision 
to  deploy  and  close  an  IBCT  anywhere  in  the  world  within  96  hours.  Next,  a  review  of  the  specific  study  objectives 
and  scenarios  examined  will  be  presented.  This  will  be  followed  by  a  review  of  IBCT  operational  considerations, 
airlift  parameters,  and  the  study  methodology.  A  “quick  look’’  technique  for  assessing  IBCT  closures  times  from 
different  origins  to  different  destinations  will  be  provided.  The  briefing  will  also  discuss  a  more  detailed  technique 
for  estimating  closure  times  based  on  two  different  simulation  models  -  the  Airlift  Flow  Model  (AFM)  and  the 
Model  for  Intertheater  Deployment  by  Air  and  Sea  (MIDAS).  Lastly,  significant  IBCT  deployment  challenges  and 
initial  findings  will  be  presented. 


Obstacle  Crossing  Performance  of  Vehicles 


Dr.  Paul  W.  Richmond 

US  Army  Engineer  R&D  Center 

Hanover,  NH  03755 

Ph:  603  646  4461,  FAX:  603  646  4640 

Paul.W.Richmond@erdc.usace.armv.mil 


George  L.  Mason 

US  Army  Engineer  R&D  Center 

Vicksburg,  MS  39180 

Ph:  601  634  2274,  FAX:  601  634  2409 

George.L.Mason@erdc.usace.armv.mil 


E.  Alex  Baylot 

US  Army  Engineer  R&D  Center 

Vicksburg,  MS  39180 

Ph:  601  634  3474,  FAX:  603  634  2409 

Erwin.A.Bavlot@erdc.usace.armv.mil 


Obstacles  can  disrupt,  impede,  and  otherwise  influence  the  outcome  of  military  operations,  understanding  when  and  how 
fast  an  obstacle  can  be  crossed  is  required  to  increase  Army  model  and  simulation  fidelity.  Obstacles  other  than  minefields, 
such  as  ditches,  berms,  cuts  and  fills,  craters,  etc  can  be  either  natural,  man  made  or  reinforced,  and  depending  on  vehicle 
capabilities,  these  obstacles  may  be  crossable,  but  at  a  greatly  reduced  speed.  Obstacle  crossing  speed  is  also  an  issue  when 
comparing  performance  between  wheel  and  tracked  vehicles,  additionally  the  performance  of  small  robotic  vehicles  must 
also  be  considered  in  emerging  simulations.  This  presentation  describes  current  efforts  by  the  Engineer  Research  and 
Development  Center  (ERDC)  to  enhance  vehicle  speed  predictions  during  an  obstacle  crossing  in  a  SAF  environment. 

The  NATO  Reference  Mobility  Model  II  (NRMM  II)  is  an  Army  standard  model  for  determining  vehicle  mobility 
performance,  primarily  by  predicting  maximum  vehicle  capable  speeds.  The  effect  of  a  linear  obstacle  on  maximum  speed  is 
determined  by  using  two  look-up  tables.  The  first  is  a  table  of  average  and  maximum  (resistance  to  motion)  forces  and 
minimum  clearances  based  on  standard  obstacle  descriptions.  If  the  minimum  clearance  is  greater  than  the  vehicle  clearance, 
the  maximum  force  is  used  to  determine  if  there  is  enough  available  traction  to  cross  the  obstacle.  If  either  the  clearance  or 
maximum  traction  tests  fail,  NRMM  II  predicts  no-go.  Otherwise,  the  average  force  is  added  to  the  total  resistance,  which  is 
used  to  calculate  the  maximum  vehicle  capable  speed  across  the  obstacle.  The  second  table  contains  vehicle  speed  versus 
obstacle  height  and  is  used  to  limit  speed  due  to  vehicle  and  driver  acceleration  tolerance  (2.5g).  These  tables  are  in  the 
individual  NRMM  II  vehicle  data  files,  and  are  produced  using  2-dimensional  vehicle  dynamics  software  (OBSMOD  and 
VEHDYN  II). 

The  extraction  of  this  information,  obstacle  description  requirements,  the  implementation  of  this  high  resolution 
data/model  into  a  lower  resolution  SAF  environment  are  discussed. 
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III  MEF  Intra-Theater  Lift  Alternatives  Study 
Ms.  Pamela  J.  Roberts 

MCCDC  (Studies  &  Analysis  Div),  Quantico,  VA  22134-5130 
703-764-6015/FAX  x3647,  robertspi  @mcedc. usmc.mil 

The  study  examines  ways  that  the  United  States  Marine  Corps  III  Marine  Expeditionary  Force  can  better  meet  its 
training  objectives  by  improving  the  capability  to  transport  its  personnel  and  equipment  to  the  various  training  sites  in  the 
Asian/Pacific  region.  The  study  will  examine  United  States  Transportation  Command  as  well  as  commercial  transportation 
alternatives.  The  measures  of  effectiveness  used  to  evaluate  the  alternatives  include  availability,  reliability,  transport  speed, 
effect  on  the  local  population,  the  number  of  days  of  degraded  operations,  and  cost. 


Air  Force  Futures  Game  Support  (AF-FGS) 

LTC  John  Sees 

Center  for  Army  Analysis 

6001  Goethals  Road,  Fort  Belvoir,  VA  22060 

703-806-5451;  FAX  703-806-5743,  sees@caa.army.mil 

The  Center  for  Army  Analysis  (CAA)  performed  the  Air  Force  Futures  Game  Support  (AF-FGS)  study  for  the  Deputy 
Chief  of  Staff  for  Operations  and  Plans  (DCSOPS),  DAMO-SSP.  The  primary  study  question  was  how  can  the  Army 
position  and  deploy  a  corps,  using  a  mix  of  prepositioining,  forward  basing,  airlift,  and  sealift,  to  close  the  corps  in  10  days. 
Multiple  scenarios  were  considered  iteratively  to  arrive  at  a  solution  that  met  the  sponsor’s  guidance.  The  principal  finding  of 
the  study  was  that  prepositioining  equipment  in  the  vicinity  of  a  conflict  destination  is  critical  to  meet  short  closure-time 
requirements.  The  study  also  provided  insight  into  the  feasibility  of  sealift.  Although  theater  support  vessels  (TSVs)  will 
provide  fast  sea  transport  in  the  future,  their  use  becomes  impractical  for  short  closure-time  requirements. 


Enabling  Strategic  Responsiveness 


LTC  Keith  D.  Solveson 

400  Army  Pentagon;  (3A474) 

Washington,  DC  20310-0400 
703-692-5637,  Keith.solveson@hqda.armv.mil 


Franklin  McKie 

Center  for  Army  Analysis 

6001  Goethals  Road,  Fort  Belvoir,  VA  22060 

703-806-5496;  mckie@caa.army.mil 


CAA  performed  the  Enabling  Strategic  Responsiveness  (ESR)  Study  for  the  Deputy  Chief  of  Staff  for  Operations,  War 
Plans  Division.  The  primary  study  question  was  how  the  Army  should  configure  and  place  prepositioned  equipment 
(PREPO)  sets  to  aid  rapid,  global  deployment.  Three  distinct  techniques  -  simulation,  optimization,  and  instability 
forecasting  -  were  used  to  answer  that  question.  The  study  generated  several  conclusions.  First,  for  the  foreseeable  future, 
PREPO  will  still  be  required  for  rapid  deployment,  for  both  Legacy  and  Interim  forces.  Second,  the  Army  should  consider 
retaining  Heavy  Legacy  PREPO  sites  and  PREPO  afloat  for  possible  employment  of  Legacy  forces  in  Eastern  Europe  and  the 
littoral  region  from  Iraq  to  India.  Third,  the  Army  should  consider  adding  an  Interim  Brigade  Combat  Team  (IBCT)  PREPO 
set  to  the  existing  PREPO  site  at  Livorno,  Italy.  Interim  and  Objective  forces  can  improve  their  deployment  time  by  stocking 
PREPO  sets  at  any  site  recommended  in  the  report.  Airlift  enablers  that  bypass  maximum  on  ground  (MOG)  limitations  can 
increase  closure  for  light  and  medium  forces.  IBCTs  can  close  faster  by  deploying  to  multiple  simultaneous  aerial  ports  of 
debarkation  (APODS).  This  implies  that  they  should  deploy  at  a  lower  level,  e.g.  battalion.  Fourth,  to  improve  rapid 
deployment,  both  the  Army  and  relevant  elements  of  the  Air  Force  should  regularly  train  on  rapid  deployment. 


Cargo  Lifter  Aerial  Transportation  System  (CATS) 

LTC  Michael  Woodqerd 

Center  for  Army  Analysis  (CAA),  Fort  Belvoir,  VA  22060-5230 

703-806-5496  FAX:  x.  5743,  woodgerdm@usfk.korea.armv.mil  Woodgerd@caa.armv.mil 

CargoLifter  AG  is  a  civilian  company  planning  to  build  a  fleet  of  200  heavy  lift  airships  for  worldwide  operations 
carrying  heavy/oversize  cargo  [a.k.a.  Big  Ugly  Freight  (BUF)].  This  study  is  an  initial  evaluation  of  the  military  potential  of 
this  company/airship.  The  study  also  is  an  overall  analysis  of  lighter-than-air  (LTA)  technology  in  a  military  role.  Study 
compares  CargoLifter  and  the  CL  160  airship  to  another  Ultra  Large  Airlifter  (ULA)  proposal  from  another  company.  Final 
part  of  study  is  a  laydown  of  how  the  military  could  employ  ULAs  as  well  as  identification  of  major  issues  involved, 
description  of  the  LTA  “industry”  and  an  historical  perspective  of  past  airship  failures  and  successes. 
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Inventory  Management  for  Items  with  Sporadic  Demand ,  Part  II 

Dr.  Tovey  C.  Bachman,  Research  Fellow 
Logistics  Management  Institute 
McLean,  Virginia  22102-7805 
(703)  917-7361  (fax  (703)  917-7596) 
tbachman@lmi.org 

Items  with  sporadic,  or  infrequent  demand  are  sometimes  thought  of  as  having  little  impact  on  readiness.  But  a  weapon 
system  may  fail  to  operate  even  if  it  is  missing  just  one  of  1000  rarely  demanded  parts.  Although  no  particular  one  of  these 
1000  parts  is  often  called  for,  at  least  one  of  them  may  required  every  time  the  system  is  repaired  (perhaps  a  different  part 
each  time.)  In  a  study  of  7000  parts  (stock  numbers)  whose  absence  was  holding  up  DoD  maintenance,  40  percent  of  those 
were  infrequently  demanded  parts,  either  stocked  in  small,  arbitrarily  set  quantities,  or  not  stocked  at  all. 

This  finding  suggests  that  better  stockage,  procurement  and  repair  policies  are  required  for  such  items.  At  the  68th 
MORSS,  we  presented  a  new  form  of  procurement  policy  for  consumable  items  with  sporadic  demand  and  assessed  the 
performance  of  alternative  policies  for  such  items.  We  present  the  results  of  extending  our  analysis  to  reparable  items,  and 
consider  new  forms  of  policies  for  both  procurement  and  repair.  Using  a  retrospective  simulation,  we  compare  alternative 
policies,  ranking  them  in  terms  of  supply  performance  for  a  fixed  inventory  investment. 

Focused  Logistics  Wargame  01  ( FLOW  01)  Intratheater  Sustainment  Lift  Analysis 


Charles  W.  Barker  III 

Systems  Planning  &  Analysis 
2000  N.  Beauregard  St.  400 
Alexandria,  VA  22311 
(703)  931-3500 
cbarker@spa-inc.net 


Carl  Lawrimore 
HQ,  MTMD-TEA 
Newport  News,  VA 
(757)  599-1111 

LawrimoC  @tea-emh  1  .armv.mil 


Tammy  Carkin 
Systems  Planning  &  Analysis 
2000  N.  Beauregard  St.  400 
Alexandria,  VA  22311 
(703)  931-3500 


Kelly  Musick 
HQ,  MTMD-TEA 
Newport  News,  VA 
(757) 599-1111 


Dorothy  Saks 

Systems  Planning  &  Analysis 
2000  N.  Beauregard  St.  400 
Alexandria,  VA  22311,  (703)  931-3500 


FLOW  01  represented  the  first  concerted  effort  to  gather  sustainment,  operational  planning  factors,  and  assumptions 
from  joint  and  combined  force  participants  for  the  examination  of  logistics  interoperability  and  interdependency  issues.  The 
portrayal  of  these  forces  within  a  common  context  provided  considerable  insights  into  distribution  analysis  and  opportunities 
for  examination  of  logistics  footprint  reduction  possibilities,  a  major  FLOW  01  objective.  This  was  most  clearly  seen  during 
a  particularly  stressing  NEA  scenario,  adapted  from  the  Mobility  Requirements  Study  05  (MRS  05).  The  scenario  combined 
the  tactical  locations  and  combat  intensities  of  major  force  elements,  modified  to  reflect  the  participating  elements  of 
coalition  partners,  and  added  in  unique  logistics  planning  factors,  support  relationships,  and  doctrinal  assumptions  of  the 
contributing  forces.  The  dynamically  changing  sustainment  requirements  were  fed  into  intratheater  distribution  and  lift 
models  to  assess  the  level  of  transportation  sufficiency  in  meeting  sustainment  requirements,  the  results  then  integrated  into  a 
theater  level  campaign  simulation  to  permit  high  level  examination  of  joint  and  combined  operational  level  logistics  and 
support  issues. 
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U.S.  Army  Recapitalization  --  Reliability  Modeling  and  Optimization 


Daniel  Briand 

Sandia  National  Laboratories 
Systems  Reliability  Department 


Bruce  Thompson 
Sandia  National  Laboratories 
Systems  Reliability  Department 
PO  Box  5800  MS  1176 
Albuquerque,  NM  87185-1176 
(505)  284-4949  (fax  (505)  844-3321) 
bmthomp  @  sandia.  go  v 


PO  Box  5800  MS  1176 
Albuquerque,  NM  87185-1176 
(505)  844-7230  (fax  (505)  844-3321) 
dbriand  @  sandia.  gov 


The  U.S.  Army  is  beginning  an  extensive  program  to  transform  its  Legacy  Force  through  a  major  Recapitalization  effort. 
Sandia  National  Laboratories’  detailed  reliability  modeling  methodology  and  genetic  optimization  will  predict  the  impact  of 
proposed  recapitalization  upgrades  then  optimize  the  upgrades  to  provide  the  greatest  performance  improvement  within 
budget  constraints. 

Modeling  the  Logistics  Support  for  the  Airborne  Laser’s  Systems  Integration  Laboratory  (ABL-SIL) 

Adam  F .  Clark  Nicholas  J.  Zeisler 

AFMC  OAS/DRA  AFMC  OAS/DRA 

3550  Aberdeen  Ave  SE  3550  Aberdeen  Ave  SE 

Kirtland  AFB,  NM  871 17  Kirtland  AFB,  NM  87117 

(505)  846-8311  (fax  (505)  846-5558)  (505)  853  -  1479  (fax  (505)  846-5558) 

Adam.Clark@kirtland.af.mil  Nicholas.Zeisler@kirtland.af.mil 

The  Airborne  Laser  is  one  of  the  Air  Force’s  components  for  the  future  Theater  Missile  Defense.  The  ABL  is  a  Boeing 
747  modified  to  carry  a  chemical  laser  capable  of  locating,  targeting  and  destroying  Theater  Ballistic  Missiles  during  boost 
phase.  The  ABL  Systems  Program  Office  (SPO)  tasked  the  Office  of  Aerospace  Studies  (OAS)  to  model  the  logistics  of  the 
ABL  s  chemicals  at  the  SIL.  The  ABL  Logistics  And  Turn-Time  Evaluation  (LATTE)  Model  answers  the  questions  of  how 
much  time  is  required  to  refill  the  chemicals  onboard  the  ABL,  and  when  to  refill  the  supporting  storage  tanks.  The  ABL 
LATTE  Model  also  has  the  flexibility  to  answer  the  same  questions  once  the  ABL  is  deployed.  This  presentation  addresses 
the  development  of  the  ABL  LATTE  Model,  the  insights  it  provides  to  the  ABL  SPO  and  its  future  capabilities  and 
applications. 

Aging  Analysis  of  Army  Equipment 

Holly  M,  Costanzi,  Operations  Research  Analyst 
US  Army  Materiel  Systems  Analysis  Activity 
392  Hopkins  Road 

Aberdeen  Proving  Ground,  MD  21005-5071 
(410)  278-7841  (fax  (410)  278-6467) 
costanzi  @amsaa.  army,  mil 

This  analysis  was  performed  for  the  Vice  Chief  of  Staff,  Army  in  support  of  questions  posed  on  aircraft  aging.  AMSAA 
conducted  this  study  to  determine  the  impact  of  an  aging  fleet  on  flight  safety.  In  order  to  determine  whether  recent  increases 
in  safety  of  flight  messages  was  due  to  fleet  aging  and  if  aging  was  apparent  in  Flight  Safety  parts  (FSP)  and  Safety  of  Flight 
(SOF)  aircraft  parts,  a  methodology  was  developed  to  identify  individual  components  that  were  potential  candidates  for 
aging. 

The  study  examined  the  components  of  four  aircraft:  Apache,  Blackhawk,  Chinook  and  Kiowa.  Parts  data  was  obtained 
from  the  US  Army  Aviation  and  Missile  Command’s  FSP  database  and  SOF  parts  from  the  SOF  messages  dated  1999  - 
2001.  In  order  to  determine  how  often  these  part  failures  occurred  to  the  point  of  being  replaced,  part  demands  from  the 
Central  Demand  Database  (CDDB)  were  pulled  from  1996  -  2001  for  these  parts.  A  statistical  test  was  performed  to  show  if 
there  was  an  increase  in  the  quantity  of  parts  demanded  from  one  period  to  another.  This  test  provided  a  method  in  which  to 
screen  any  parts  showing  an  increase  in  quantity  demanded  as  potential  aging  parts. 

The  results  were  informative.  For  both  the  FSP  and  SOF  parts,  aging  was  evident  for  one  of  the  aircraft,  where  48%  of 
the  FSP  components  and  58%  of  the  SOF  components  showed  an  increase  in  replacement  rates. 
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Readiness-based  Leveling  Supports  Contingencies 

1st  Lt  Marc  Ferguson,  USAF 
AFLMA/LGY 

501  Ward  St,  Maxwell  AFB  Gunter,  AL  36114 
(334)  416-4822  FAX:  (334)  416-4638 
marcus.Ferguson@maxwell.af.mil 

The  Air  Force  currently  allocates  reparables  (or  repairable  parts)  to  its  bases  worldwide  for  both  normal  peacetime 
operations  and  contingencies.  Congress  provides  a  limited  annual  budget  with  which  to  buy,  store,  and  repair  parts,  so  a 
never-ending  stockpile  of  parts  is  unrealistic.  Hence,  the  need  arises  to  optimally  allocate  scarce  parts  to  the  bases  that  need 
them  the  most. 

In  April  1997,  the  AFLMA  released  the  Readiness-based  Leveling  (RBL)  model.  The  goal  of  RBL  is  to  minimize 
expected  backorder  days  by  authorizing  levels  (or  reservations)  of  reparables  to  the  bases  that  require  them.  RBL  essentially 
standardizes  authorizations  among  all  Air  Forces  bases  based  on  the  worldwide  requirement  and  historical  demand  data. 
AFMC  runs  RBL  quarterly  in  order  to  allocate  the  authorizations  based  on  up-to-date  demand  data. 

RBL's  distribution  of  levels  to  bases  has  proven  to  be  efficient  during  peacetime,  but  what  would  we  do  when 
contingencies  occur?  The  problem  with  establishing  authorizations  during  contingencies  is  that  historical  demand  data  cannot 
accurately  forecast  the  need.  The  AFLMA  developed  a  Contingency  High-Priority  Mission  Support  Kit  (CHPMSK)  approval 
process.  This  brief  will  introduce  RBL  and  discuss  a  recent  CHPMSK  approval  process  that  supported  Operation  Enduring 
Freedom. 


Forecasting  the  NBC  Medical  Logistics  Impact 


Michael  T.  Gatelv 

ScenPro,  Inc. 

101  W.  Renner  Road  Suite  130 
Richardson,  Texas  75082 
(972)  437-5001  (fax  (972)  437-3611) 
MGatelv@ScenPro.com 

Dr.  Gene  E.  McClellan 
Veridian  Systems  Division,  Inc. 

1400  Key  Blvd.  Suite  700 
Arlington,  VA  22209 
(703)516-6204  (fax  (703)  524-2420) 
Gene.McClellan@Veridian.com 


Sharon  M.  Watts 
ScenPro, Inc. 

101  W.  Renner  Road  Suite  130 
Richardson,  Texas  75082 
(972)  437-5001  (fax  (972)  437-361 1) 
swats  @  scenpro.com 

William  J.  Klenke 
Anteon,  Inc. 

AMEDDC&S  (MCCS-FCC-PP),  Building  44 
Fort  Sam  Houston,  TX  78234-6175 
Phone:  (210)  295-0531  FAX:  210-221-0121 
William.Klenke@cen.amedd.armv.mil 


The  Nuclear,  Biological,  and  Chemical  Casualty  Resource  Estimation  Support  Tool  (NBC  CREST)  performs  two  key 
functions:  estimate  casualties  for  an  NBC  scenario  and  the  resources  necessary  to  effectively  treat  those  casualties.  The 
resource  estimation  module  uses  JRCABs  TTT  and  DEPMEDS  databases  to  compute  the  time-phased  resource  requirements 
for  the  casualty  stream.  These  data  are  presented  as  a  series  of  Excel  spreadsheets  that  can  be  manipulated  by  a  logistician. 
NBC  CREST  was  developed  in  conjunction  with  the  Army  Office  of  the  Surgeon  General  and  designed  to  perform  deliberate 
medical  planning  at  the  Corps,  Division,  and  Corps  Medical  Brigade  levels.  The  resources  estimated  are  Beds,  personnel  by 
MOS,  Class  VIII  A  by  NSN,  Class  VIII  B,  and  evacuation  resources.  The  tool  separates  resources  needed  for  prophylaxis, 
decontamination,  and  the  treatment  for  illness,  in  addition  to  a  straightforward  enumeration  of  resources  required  for  patient 
treatment.  The  tool  can  assign  the  resource  consumption  to  specific  medical  treatment  facilities,  allowing  the  medical  planner 
to  optimize  the  medical  footprint  and  the  evacuation  network  by  performing  an  iterative  analysis  to  eliminate  resource 
shortfalls.  Finally,  different  medical  footprints  and  networks  can  be  compared  against  user-defined  Deployment,  Disposition, 
and  Utilization  criteria.  This  presentation  will  provide  an  overview  of  NBC  CREST,  review  the  key  features  of  the  resource 
estimator,  and  discuss  the  implications  for  logisticians. 


Analysis  of  Physical  Distribution  Operations  in  Maneuver  Support  Organizations 


MAJ  Gregory  H.  Graves 

HQ  US  Army  Combined  Arms  Support  Command 

3901  A  Ave.,  Suite  220 

Fort  Lee,  VA  23801 

(804)  734-0610  (fax  (804)  734-0336) 

gravesg@lee.army.mil 
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As  the  Army  transitions  to  a  distribution-based  logistical  support  system,  the  criticality  of  accurately  designing  and 
resourcing  logistics  units  has  become  evident  at  the  highest  levels  of  leadership  in  the  logistics  community.  Units  that 
reconfigure  or  transship  cargo  act  as  nodes  in  the  distribution  system  and  are  of  primary  importance  in  this  effort.  Analysts  in 
the  Army’s  Combined  Arms  Support  Command  (CASCOM)  have  been  actively  engaged  in  analyzing  these  units  and  are 
developing  analysis  tools  to  aid  in  the  combat  developments  process.  The  Army’s  Deputy  Chief  of  Staff  for  Logistics 
sponsored  CASCOM’s  Container/Materials  Handling  Equipment  (CMHE)  Study  as  an  initial  step  in  improving  the 
resourcing  of  these  units. 

The  Analysis  of  Physical  Distribution  Operations  in  Maneuver  Support  Organizations  study  effort  is  exploiting  the 
lessons  learned  and  tools  developed  during  the  CMHE  Study.  Process  maps  to  document  operational  methods  within  units 
serve  as  the  basis  for  deterministic  analysis  tools  and  simulation  models  developed  using  Arena.  This  presentation  shows 
refinements  made  to  the  suite  of  decision  support  tools  developed  during  the  CMHE  Study  and  illustrates  the  methodology 
used  to  employ  them  in  the  combat  developments  process  for  distribution  units.  Interim  results  comparing  deterministic  and 
simulation  analysis  are  also  presented. 

Critical  Review  of  TloaDS  and  CloaDS  Inputs 

Robert  Hamber 

Naval  Facilities  Engineering  Service  Center 
1100  23rd  Ave 

Port  Hueneme,  CA  93043-4370 

(805)982-1583 

hamberra@nfesc.navy.mil 

TLoaDS  is  a  mid-fidelity,  high-resolution,  PC-based  stochastic,  discrete  event,  simulation  of  tactical  and  operational 
logistics.  Its  forte  is  simulating  force  sustainment,  but  the  new  generation  introduces  the  ability  to  schedule  loads  or  sorties. 
This  improves  TLoaDS  flexibility  to  simulate  deployment,  debarkation,  assault,  unit  maneuver,  combat  support  and  CSS 
sorties;  and  the  competition  for  resources.  TLoaDS  is  very  flexible,  with  more  process  parameters  than  any  other  model  of 
tactical  logistics.  Its  core  module  is  built  on  three  integrated  commercial  discrete  event  simulation  packages  used  by  a 
number  of  Fortune  100  companies  and  Department  of  Energy  activities  for  supply  chain  analysis.  Other  modules  include 
preprocessor  spreadsheets,  reference  database  manager,  study  database  builder,  mapping  and  laydown  tools,  task  organization 
and  consumption  tool,  load  and  mode  planning  tool,  initial  resources  allocation  optimizer,  supply  chain  investigator,  map- 
based  supply  chain  animator,  plot  and  chart  tools,  table  and  trace  report  generators,  post  processor,  and  the  standard  MS  Help 
system.  Half  of  these  modules  are  either  new,  or  have  major  enhancements  since  the  previous  generation  of  TLoaDS  was 
demonstrated  at  MORSS  last  year. 

This  presentation  covers  the  inputs  and  algorithms  used  for  consumption,  and  ordering.  How  nominal  consumption  rates 
are  computed,  consumption  influencing  conditions  are  scripted,  actual  consumption  is  computed  and  monitored,  ordering  is 
triggered  and  scheduled,  order  amounts  computed,  orders  sent  and  delayed  and  assigned  to  suppliers,  is  detailed.  Areas 
where  we  desire  improved  input  validation  and  process  modeling  is  also  addressed.  How  orders  are  filled,  deliveries  are 
routed  and  attritted,  and  material  is  received  is  not  covered  due  to  presentation  time  limits. 


Global  Combat  Support  System  T&E 


Ric  Harrison 

Joint  Interoperability  Test  Command 

(JITC),  Bldg  57305 

Huachuca,  AZ  85613 

(520)  538-5124  (fax  (520)  538-5003) 

harrisor@fhu.disa.mil 


Sarah  Patno 
101  Strauss  Ave 
Indian  Head,  MD 

(301)  744-2697  (fax  (301)  744-2603 
patnos@ncr.disa.mil 


Mike  Koester 

Joint  Interoperability  Test  Command 

(JITC),  Bldg  57305 

Ft  Huachuca,  AZ  85613 

(520)  538-4230  (fax  (520)  538-5003) 

koesterm@fhu.disa.mil 


The  Joint  Interoperability  Test  Command  (JITC)  is  forging  new  ground  as  the  Operational  Test  Agency  (OTA)  for  the 
Global  Combat  Support  System  (GCSS).  GCSS  is  a  joint  strategy  to  focus  combat  support  information  on  decisions  related  to 
planning  and  executing  military  actions  through  the  use  of  a  comprehensive  suite  of  combat  support  software.  Joint  GCSS  is 
a  family-of-systems  (FoS)  that  act  as  a  paradigm  in  the  way  automated  information  systems  of  the  future  will  be  developed. 
GCSS  is  being  developed  to  fill  the  need  for  focused  logistics  called  for  as  one  of  the  pillars  of  Joint  Vision  2010  (JV2010). 

GCSS  Commander-in-Chief/Joint  Task  Force  (CINC/JTF)  provides  read-only  access  to  timely,  accurate  and 
comprehensive  Combat  Support  information  located  in  various  host  databases  around  the  world.  GCSS  (CINC/JTF)  provides 
the  ability  to  view  relevant  logistics  data  in  a  tailored  format  and  allows  CINCs  and  Commander  Joint  Task  Force  (CJTFs)  to 
use  that  data  as  the  input  to  the  tactical  decision  process. 

The  size  and  complexity  of  GCSS,  coupled  with  the  unique  acquisition  strategy  and  the  dynamic  schedule,  pose 
challenges  for  the  test  community.  JITC  has  developed  a  comprehensive  strategy  for  GCSS  Test  and  Evaluation  (T&E). 
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This  strategy  is  designed  to  meet  the  unique  challenges  posed  by  GCSS  and  provide  timely  information  to  the 
Warfighter,  Department  of  Defense  (DoD)  Joint  Staff,  Director  Operational  Test  and  Evaluation  (DOT&E),  Defense 
Information  Systems  Agency  (DISA)  and  the  Milestone  Decision  Authority  (MDA). 

As  the  operational  tester  for  GCSS,  JITC  ensures  the  Warfighter’s  perspective  is  captured  as  value-added  to  the 
development  process.  During  each  Field  Test  JITC  assesses  the  operational  effectiveness  and  operational  suitability  of  the 
GCSS  version  release  under  test. 

Through  interoperability  certification,  we  ensure  the  warfighter  can  obtain  information  that  is  accurate,  timely,  and 
useful.  Based  on  the  Warfighter's  requirements  for  information  exchange  and  through  our  efforts  in  evaluating  incremental 
software  releases,  we  help  assimilate  new  and  affordable  technology  more  quickly  into  our  fight  and  win  systems. 

Modeling  Logistics  in  a  Theater  Warfight 

Douglas  “Ben”  Herr  Tim  Gannon 

Civilian  Contractor  (Unisys)  Civilian  Contractor  (GRCI) 

OSD,  PA&E  Simulation  and  Analysis  Center  OSD,  PA&E  Simulation  and  Analysis  Center 

1401  Wilson  Blvd.,  Suite  300  1401  Wilson  Blvd.,  Suite  300 

Arlington  VA  22209-2306  Arlington  VA  22209-2306 

(703)  696-9360  (fax  (703)  696-9394)  (703)  696-9360  (fax  (703)  696-9394) 

douglas.herr@osd.pentagon.mil  timothv.gannon@osd.pentagon.mil 

Most  likely,  conflicts  in  the  future  will  have  the  U.S.  fighting  with  coalition  forces.  In  some  instances,  the  host  nation  in 
the  theater  of  operations  has  agreed  to  provide  logistical  support  to  the  US  military.  Additionally,  the  host  nation  provides 
logistical  support  to  their  own  forces.  What  is  the  impact  on  US  operations  when  host  nation  support  is  degraded,  and  /or 
coalition  forces  cannot  adequately  support  themselves  and  the  US  must  now  provide  their  logistics  support? 

This  briefing  describes  how  the  Simulation  and  Analysis  Center  (SAC)  continues  to  analyze  the  impact  of  logistics  in  a 
theater  warfight.  In  particular,  this  initial  effort  determined  the  potential  impact  of  coalition  force  logistics  requirements  on 
the  US  logistics  infrastructure.  Coalition  logistics  consumption  data  was  estimated  using  Combined  Arms  Support  Center  s 
(CASCOM)  OPLOG  Planner  and  integrated  into  Enhanced  Logistics  Intratheater  Support  Tool  (ELIST).  The  results  show 
the  magnitude  of  support  that  the  US  may  need  to  provide  when  coalition  operations  exceed  their  own  logistics  capability. 

Answering  the  Right  Question:  Logistics  Network  Analysis 

Douglas  Hoffman,  Military  Logistics  Analyst 

Joint  Warfare  Analysis  Center 

18385  Frontage  Road,  Building  1450T 

Dahlgren,  VA  22448-5500 

(540)  653-5865  (fax  (540)  653-5612) 

dhoffman@iwac.osis.gov 

This  analysis  looks  at  the  use  of  a  blue  force  logistics  model  to  evaluate  a  plan  to  isolate  an  airfield.  The  model  used  is 
the  Logistics  Joint  Analysis  Model  (LogJAM),  which  was  developed  for  the  Army  Research  Laboratory  as  the  Knowledge 
Based  Logistics  Planning  Shell  (KBLPS).  Its  original  purpose  was  to  estimate  the  usage  and  distribution  of  various  classes  of 
supply  for  the  Army  logistics  planners.  Now,  LogJAM  is  employed  to  estimate  the  logistical  needs  and  shortfalls  of  red 
forces. 

In  this  analysis  case,  we  are  concerned  with  the  red  logistics  of  a  particular  aircraft  at  an  airfield.  This  case  was 
established  to  mimic  a  possible  military  objective.  Specifically,  it  assumed  that  a  force  wants  to  deny  the  enemy  the  ability  to 
use  a  specific  type  of  aircraft  in  combat.  In  order  to  eliminate  the  use  of  an  aircraft,  either  it  must  be  destroyed,  or  the 
resources  that  it  utilizes  must  be  eliminated.  In  this  case,  the  goal  is  to  eliminate  these  resources,  in  particular,  aviation  fuel. 

One  way  to  attain  the  denial  objective  is  by  cutting  the  supply  routes  to  the  airfield.  However,  in  this  case,  the 
geography  around  the  airfield  and  the  existing  local  inventory  make  it  nearly  impossible  to  isolate  the  airfield  completely  in 
order  to  ground  the  aircraft.  So,  in  addition  to  supply  route  isolation,  a  reduction  in  the  airfield  fuel  inventory  is  examined. 
As  a  result,  it  is  discovered  that  both  the  resupply  routes  and  the  inventory  must  be  affected  in  order  to  ground  the  aircraft 
over  time.  Then,  the  model  is  used  for  sensitivity  analysis  in  order  to  give  a  range  of  time  by  which  one  could  expect  the 
aircraft  to  be  grounded. 

In  addition  to  modeling  aircraft  fuel  consumption,  approaches  to  modeling  aircraft  ammunition  consumption  have  been 
tested.  Preliminary  work  is  also  being  done  for  this  type  of  supply  modeling  with  regard  to  naval  forces.  Provided  that  the 
data  can  be  gathered  and  assumptions  are  documented,  this  type  of  logistics  modeling  will  allow  for  more  realistic  impacts 
assessments  on  methods  used  to  attain  military  goals. 
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Mechanical  Physics  of  Failure  Initiatives 

James  Horchner,  Mechanical  Engineer 
US  Army  Materiel  Systems  Analysis  Activity 
392  Hopkins  Road 

Aberdeen  Proving  Ground,  MD  21005-507 1 
(410)  278-4490  (fax  (410)  278-3111) 
horchner@amsaa.armv.mil 

This  paper  outlines  the  mechanical  physics-of-failure  (PoF)  initiatives  being  performed  by  the  US  Army.  The  first 
mechanical  PoF  initiative  is  the  ongoing  analysis  of  an  Army  trailer,  which  uses  an  integrated  process  of  dynamic  modeling, 
finite  element  modeling,  and  durability  analysis.  The  modeling  approach  starts  by  using  terrain  data  gathered  by  the 
Aberdeen  Test  Center  for  use  in  the  dynamic  models.  The  dynamic  model  used  in  this  project  is  multi-body  model  Dynamic 
Analysis  Design  Simulation  (DADS).  DADS  is  used  for  a  rigid-body  analysis  and  a  flexible-body  analysis,  using  finite 
element  analysis.  The  flexible-body  DADS  model  is  used  to  determine  the  dynamic  accelerations  at  all  points  on  the  trailer. 
NASTRAN  is  used  as  the  finite  element  model  in  this  project.  Finally,  the  University  of  Iowa,  Durability  and  Reliability 
Analysis  Workspace  (DRAW)  software  tool  will  be  used  to  integrate  results  from  dynamic  modeling  and  finite  element 
modeling  (i.e.,  dynamic  stress  and  strain)  for  durability  analysis.  This  project  outlines  an  approach  to  mechanical  reliability 
analysis  that  can  be  used  early-on  in  design. 

The  tools  developed  during  the  trailer  project  are  also  applicable  to  Test  &  Evaluation  (T&E)  related  issues.  The 
Improved  Ribbon  Bridge  (IRB)  and  the  Dry  Support  Bridge  (DSB)  acquisition  programs  sponsored  by  the  US  Army  Tank- 
Automotive  and  Armaments  Command,  are  utilizing  PoF  fatigue  analysis  tools  to  evaluate  the  structural  fatigue  induced  by 
physically  simulated  loads  applied  during  testing  and  compare  them  to  real-world  usage  loads.  In  this  application,  PoF  tools 
will  enable  substantial  test  cost  savings  by  serving  as  the  validation  tool  to  accredit  the  physical  simulation  Modeling  & 
Simulation  (M&S)  being  employed  on  these  programs.  Other  uses  of  PoF  in  support  of  T&E  include  Dynamic  Modeling, 
Finite  Element  Analysis  (FEA),  and  Life  Prediction  for  early  evaluations,  corrective  action  verification,  and  what-if  analyses. 


Aviation  Safety  Cumulative  Risk  Aggregation  Modeling — Failure  plus  Consequences 


Jane  G.  Krolewski 

US  Army  Materiel  Systems  Analysis  Activity 
392  Hopkins  Rd. 

Aberdeen  Proving  Ground,  MD  21005-507 1 
(410)  278-4657  (fax  (410)  278-3 1 1 1) 
hock@amsaa.armv.mil 


Michael  J.  Cushing,  Ph.D. 

US  Army  Materiel  Systems  Analysis  Activity 
392  Hopkins  Rd. 

Aberdeen  Proving  Ground,  MD  21005-5071 
(410)278-4739  (fax  (410)  278-31 1 1) 
cushing@amsaa.armv.mil 


To  support  the  Aviation  Safety  Integrated  Product  Team,  the  Aviation  and  Missile  Research,  Development  and 
Engineering  Center  (AMRDEC)  asked  the  U.S.  Army  Materiel  Systems  Analysis  Activity  (AMSAA)  to  develop  a  model  that 
aggregates  the  individual  risk  from  each  System  Safety  Risk  Assessment  (SSRA)  and  determines  the  cumulative  risk  on  an 
aviation  system.  The  SSRAs  address  the  materiel  risk  of  the  component,  and  do  not  address  risks  due  to  the  environment, 
personnel,  doctrine  or  training.  This  risk  generally  correlates  to  reliability  because  it  considers  the  component  failure  plus  the 
consequences.  AMSAA  developed  two  models  to  aggregate  the  individual  component  SSRA  risks.  These  models  are  not 
predictive,  but  provide  the  cumulative  level  of  risk  as  SSRAs  are  identified  and  resolved  through  time.  This  allows  the 
decision  maker  to  consider  the  cumulative  risk  of  the  system  due  to  all  known  SSRAs  when  deciding  whether  to  accept  the 
risk  proposed  by  the  latest  SSRA.  The  first  model  aggregates  component  hazard  functions  and  can  assess  risk  at  the  fleet 
level  and  also  provide  the  risk  associated  with  each  helicopter  tail  number.  This  model  can  address  helicopter-to-helicopter 
variability  and  will  calculate  the  risks  at  any  point  in  the  life-cycle.  However,  the  model  requires  component  aging  models 
and  component-age  data.  Component-aging  models  and  component-age  data  are  not  currently  available  for  all  of  the  SSRA 
components.  AMSAA  has  developed  an  alpha-version  tool  for  this  model  in  Mathematica.  The  second  model  aggregates  the 
expected  number  of  yearly  accidents  for  each  SSRA  over  a  20-year  time  horizon.  This  model  addresses  only  fleet  level  risk, 
and  not  the  individual  risk  for  each  helicopter.  However,  the  data  requirements  for  this  model  match  the  current  state  of  data 
collection.  AMSAA  has  developed  two  versions  of  this  model,  one  in  Mathematica  and  one  in  Excel.  The  model  software 
generates  tables  and  graphs  of  expected  accidents  as  a  function  of  calendar  time  and  the  next  n  flight  hours.  The  software  also 
calculates  and  plots  accident  probabilities.  AMSAA  also  researched  risk  communication  methods  currently  in  use  in  the  risk- 
mitigation  community,  and  provided  alternative  communication  ideas  for  the  Aviation  Safety  Integrated  Product  Team  to 
propose  to  their  decision  makers. 
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Evaluation  of  Combat  Service  Support  Logistics  Concepts  for  Supplying  a  USMC  Regimental  Task  Force 

Capt  Thomas  A.  Lenhardt,  USMC 
USJFCOM,  J9 

1562  Mitscher  Ave,  Suite  200 
Norfolk,  VA  23551-2488 
(757)  836-3954  (fax  (757)  836-2885) 
lenhardtt@ie.jfcom.mil 

One  of  the  primary  responsibilities  of  a  Marine  Corps  Combat  Service  Support  Element  (CSSE)  is  to  provide  water,  fuel, 
and  ammunition  requirements  for  the  primary  task  forces  and  other  Marine  Expeditionary  Force  (MEF)  elements.  This  thesis 
evaluates  existing  and  proposed  concepts  on  how  to  best  use  the  CSSE  resources  of  a  Force  Service  Support  Group  to 
transport  supplies  to  Regimental  Combat  Teams  over  constrained  networks  with  time  constraints.  A  model  was  developed 
that  optimizes  the  use  of  resources,  assets,  and  network  routes.  The  model  first  solves  a  capacitated  vehicle  routing  problem, 
where  a  set  of  customers  has  to  be  served  by  a  fleet  of  vehicles  within  a  certain  time.  The  stochastic  aspects  of  the  problem 
are  modeled  through  the  use  of  a  discrete  event  simulation  that  uses  the  results  of  the  optimization  model.  The  optimization 
model  goes  beyond  the  traditional  routing  problem  by  accounting  for  special  features  such  as  vehicle  capacity  for  each 
commodity  and  cargo  incompatibility  (e.g.  fuel  and  ammunition).  The  model  includes  both  optimization  of  routes  and 
simulation  of  stochastic  elements.  As  a  result,  this  thesis  establishes  a  basis  for  future  studies  involved  with  modeling  new 
concepts  in  Combat  Service  Support 


Simulation  Analysis  of  USMA  Reception  Day 


2LT  Dominik  Noqic 

D/Systems  Engineering,  USMA 
West  Point,  NY  10996 

(845)  515-4076;  (845)  938-5919,  x24400@usma.edu 


MAJ  Michael  Nowatkowski 
D/Systems  Engineering,  USMA 
West  Point,  NY  10996 

(845)  938-2668;  (845)  938-5919,  fm7971@usma.edu 


USMA  Reception  Day  planners  approached  our  research  team,  requesting  that  we  create  a  simulation  model  in  order  to 
test  the  effects  that  several  proposed  changes  would  have  on  the  system.  Ultimately,  the  planners  want  to  minimize  the  time 
it  takes  a  new  cadet  to  get  through  the  system  with  a  minimum  numbers  of  employees  manning  the  stations.  They  also 
expressed  a  desire  to  reduce  the  total  time  that  the  system  is  in  operation.  Since  we  will  be  creating  a  simulation,  we  can  see 
real  time,  the  effect  that  proposed  changes  would  have  on  the  system. 

In  order  to  create  this  model  we  will  use  a  systematic  approach  to  problem  solving  that  will  ensure  that  we  produce  an 
accurate  and  effective  model.  Through  the  use  of  stakeholder  analysis  we  will  determine  the  specific  objectives  of  our 
clients.  Using  these  objectives,  it  then  becomes  possible  to  use  the  simulation  model  to  conduct  a  thorough  statistical 
analysis  of  the  model  and  the  alternatives.  Specifically,  the  use  of  Design  of  Experiment  (DOE)  and  experimental  design 
processes  will  allow  us  to  see  if  proposed  changes  to  the  base  model  have  a  statistically  significant  effect  on  the  objective 
values.  Ultimately,  the  goal  of  this  analysis  is  to  create  a  tool  that  will  facilitate  and  aid  the  decision  making  process  for  how 
to  best  organize  and  configure  the  Thayer  Hall  system.  We  feel  that  through  the  use  of  simulation  software  we  will  be  able  to 
accurately  gauge  the  effect  that  slight  changes  on  the  model  will  have  on  the  objective  values  and  be  able  to  recommend  to 
the  planners  the  best  way  to  configure  the  R-Day  Thayer  Hall  system  so  that  their  objectives  are  met  with  the  utmost  resource 
efficiency. 


AF  Regional  Stockage  Policy  Opportunities 

2nd  Lt  Rachel  Oates,  USAF 
AFLMA/LGY 

501  Ward  St.  Maxwell  AFB  Gunter,  AL  361 14 
(334)416-4524  (fax  (334)  416-4638) 
Rachel.oates@maxwell.af.mil 


In  an  effort  to  reduce  manning  and  increase  efficiency,  four  AF  major  commands  have  regionalized  back-shop  supply 
functions  to  regional  supply  squadrons.  Back-shop  functions  include  equipment  management,  stock  control,  mission 
capability  or  MICAP,  funds  management,  record  maintenance  and  computer  operations.  Centralizing  AF  stockage  policies 
potentially  provides  opportunities  to  further  the  regional  concept  and  implement  innovative,  effective  and  efficient  AF 
stockage  policies.  Therefore,  HQ  USAF/IL-I  tasked  the  AFLMA  to  identify  opportunities  to  improve  AF  support  by 
centralizing  retail  stockage  policies. 

In  this  presentation,  we  focus  on  two  aspects  of  the  study.  First  we  analyze  the  stockage  policy  to  reduce  MICAPs.  The 
trade-off  is  that  there  is  a  cost  associated  with  each  MICAP  reduced.  The  second  aspect  of  the  study  involves  stock  control. 
Specifically,  we  look  at  opportunities  to  laterally  support  within  three  major  regions,  CONUS,  PACAF,  and  USAFE. 
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Automated  Logistics  Information  to  the  Air  Operations  Center 

Kristina  M.  O’Brien 

238  Hartson  St.,  Hurlburt  Field,  FL  32544 
(850)  884-8258  (fax  (850)  884-8232) 

Kristina.obrien  @  hurlburt.af.mil 

Currently,  no  readily  accessible,  decision-quality,  combat  support  (CS)  information  is  available  to  the  Director  of 
Logistics  (A4)  to  support  the  Commander,  Air  Force  Forces  (COMAFFOR)  or  the  Joint  Force  Air  Component  Commander 
(JFACC)  in  the  Air  Operations  Center  (AOC).  Combat  support  data  is  manually  collected  as  required  and  all 
reports/information  are  manually  generated.  Gathering  the  data  is  labor  intensive  and  time-consuming,  and  it  results  in  an 
ineffective  use  of  personnel. 

The  goal  of  the  Automated  Logistics  Information  to  the  AOC  (ALIA)  initiative  was  to  provide  the  JFACC  staff  with 
current,  accurate,  decision-quality  CS  information.  To  accomplish  this,  ALIA  captures  and  compiles  wing-level  CS  data, 
available  in  Theater  Battle  Management  Core  Systems-Unit  Level  (TBMCS-UL),  using  Broadsword  capabilities. 
Broadsword  is  an  Air  Force  Research  Lab  program  that  provides  users  simultaneous  access  to  multiple  and  geographically 
separated  data  sources  through  employment  of  a  secure  web  browser.  Broadsword  automatically  compiles  the  data  retrieved 
from  TBMCS-UL  systems  throughout  the  area  of  operation  (AOR)  into  CS  decision  quality  web-based  reports  and  stoplight 
charts  tailored  to  meet  the  needs  of  the  AFFOR/A4  and  AOC  staff. 

Model  to  Improve  RAM  and  Supportability  in  Requirements  &  Acquisitions 

Bernard  C.  Price 

US  Army  Communications  Electronics  Command 

Office  of  the  DCSOPS,  Systems  Analysis  Division,  Bldg  1207,  Ft.  Monmouth,  NJ  07703 
(732)  532-8752  (fax  (732)  532-2993),  Bernard.Price@maill.monmouth.armv.mil 

The  Communications-Electronics  Command  (CECOM)  has  developed  a  Reliability,  Availability,  Maintainability 
(RAM)  and  Supportability  analysis  model  that  provides  integrated  solutions  for  analyzing  and  developing  Army  and 
Warfighter  RAM  requirements.  The  name  of  this  model  is  the  Achieving  a  System  Operational  Availability  Requirement 
(ASOAR)  model.  This  model  has  the  potential  to  dramatically  improve  the  state-of-the-art  for  implementing  DoD  5000. 2-R, 
paragraph  C5.2.3.5.8  covering  RAM  and  help  support  Total  Ownership  Cost  reduction. 

The  ASOAR  model  is  used  to  optimally  allocate  a  system  readiness  requirement  to  Operational  Availability  (Ao)  goals 
for  its  end  items  being  separately  acquired.  Since  the  ASOAR  model  requires  only  system  and  end  item  indenture  level 
inputs,  it  can  be  used  early  in  the  acquisition  cycle  to  determine  the  feasibility  or  costliness  of  an  Ao  requirement. 
Additionally,  ASOAR  has  the  capability  to  analyze  the  Ao  and  Mission  Reliability  for  a  fleet  of  similar  systems  used  for 
accomplishing  a  mission. 

As  an  integrated  RAM  and  Supportability  analysis  model,  ASOAR  will  help  to  determine  Mission  Reliability, 
Maintenance  Ratio  and  Ao  Key  Performance  Parameter  (KPP)  requirements.  Model  usage  will  lead  to  an  improvement  over 
the  present  off-line  Reliability  and  Maintainability  (R&M)  analyses  performed  by  the  Army  Training  &  Doctrine  Command. 
Since  Ao  is  an  integral  part  of  the  R&M  requirements  analysis  performed  by  ASOAR,  the  tool  can  help  the  Army  to  start 
determining  and  utilizing  Ao  KPP  requirements  in  accordance  with  DoD  5000.2-R. 

Integrated  solutions  help  to  lead  to  collaborative  efforts  across  various  communities.  ASOAR  outputs  tied  to  achieving 
a  weapon  system  readiness  requirement  help  to  determine  the  Ao  inputs  to  use  in  supportability  optimization  modeling. 
Supportability  optimization  models  yield  the  least  cost  supply  and  maintenance  concepts  for  an  end  item  to  achieve  its 
inputted  Ao  goal. 

Mathematically,  system  effectiveness  depends  on  the  probability  that  the  system  will  perform  appropriately  in  a  mission, 
the  probability  the  system  will  last  the  duration  of  a  mission  without  failing,  and  the  probability  the  system  is  available  to 
accomplish  a  mission.  The  probability  the  system  will  last  the  mission  duration  without  failing  is  its  Mission  Reliability  and 
the  probability  the  system  is  available  for  accomplishing  a  mission  is  tied  to  its  Ao  prior  to  fielding  and  Readiness  Rate  after 
fielding.  If  ASOAR  Ao  and  Mission  Reliability  outputs  are  used  in  conjunction  with  performance  models  that  determine  the 
probability  that  the  system  will  perform  appropriately  in  a  mission,  system  effectiveness  can  be  better  analyzed. 

Applications  of  an  On  Station  Availability  (OS A)  Model 

Capt  David  Quick  Lt  Col  Harry  Conley 

HQ  ACC/DRY  HQ  ACC/DRYS 

204  Dodd  Blvd  Ste  226,  Langley  AFB,  VA  23665-2777  204  Dodd  Blvd  Ste  226,  Langley  AFB  VA  23665-2777 

(767)  764-7262  (fax  (767)  764-7217)  (757)  764-5718  (fax  (767)  764-7217) 

david.quick@langlev.  af.mil  harrv.conlev@langlev.af.mil 
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Many  current  and  future  Air  Force  platforms  rely  upon  small  fleets  to  provide  continuous  Combat  Air  Patrols 
(CAPs).  The  ability  of  the  platforms  to  meet  their  On  Station  Availability  (OSA)  requirements  depends  on  aircraft 
performance,  concepts  of  operation  (CONOPS),  and  logistics.  ACC/DRY  developed  an  OSA  process  flow  model  that  is 
flexible  enough  to  be  modified  and  applied  to  different  platforms.  The  model  provides  a  visualization  of  the  process  that 
helps  decision  makers  understand  the  issues,  improving  acceptance  of  the  results.  To  date,  DRY  has  evaluated  aspects  of  the 
Airborne  Laser  (ABL),  Multi-Platform  Radar  Technology  Insertion  Program  (MP-RTIP),  and  the  Global  Hawk  UAV.  For 
example,  critical  acquisition  decisions  on  the  ABL  weapon  system  are  driven  by  the  need  to  service  the  laser  chemicals.  The 
model  shows  the  OSA  impact  of  these  specialized  chemical  requirements.  This  presentation  will  discuss  the  OSA  process 
model,  but  will  focus  on  the  flexibility  of  the  model  and  its  application  across  a  range  of  issues  and  platforms,  including 
tradeoffs  between  reliability  and  maintainability  requirements  and  sensitivity  analysis  on  force  structure  and  CONOPS. 

Applying  Simulation  to  Evaluate  Marine  Corps  Logistics  Initiatives 

Capt  Norman  L.  Reitter.  USMC  Capt  Craig  P.  Barnett,  USMC 

Headquarters,  U.S.  Marine  Corps  Headquarters,  U.S.  Marine  Corps 

DC  Installations  and  Logistics  (LX),  2  Navy  Annex  DC  Installations  and  Logistics  (LX),  2  Navy  Annex 

Washington,  DC  20380-1775  Washington,  D.C.  20380-1775 

(703)  695-8800/8864  (fax  (703)  695-6223)  (703)  695-8800/8864  (fax  (703)  695-6223) 

reitternl@hqmc.usmc.mil  barnettcp  @  hq  me .  usme .  mi  1 

The  Marine  Corps  is  undertaking  initiatives  to  realize  resource  efficiencies,  similar  to  those  achieved  by  industry  leaders, 
while  maintaining  or  improving  support  to  forward  deployed  units.  Several  of  these  initiatives  include  creating  a  more 
efficient  logistics  chain  by  realigning  fulfillment  processes  and  reducing  the  logistics  responsibilities  of  combat  arms  units. 
Metrics  have  been  established  to  determine  how  well  the  logistics  chain  supports  the  warfighter.  These  are  also  used  to 
measure  the  effectiveness  of  the  initiatives  based  on  ongoing  proof  of  concept  experimentation.  We  show  how  we  apply 
simulation  to  provide  another  experimentation  medium  to  estimate  the  impact  of  these  initiatives  on  the  logistics  chain 
metrics.  By  modeling  the  Marine  Corps'  order  fulfillment  process  we  are  able  to  show  how  changes  in  information  and 
product  flows  impact  the  expected  quality  of  support  provided  to  Marine  Corps  warfighters.  We  are  also  able  to  show  how 
moving  logistics  responsibilities  upstream  in  the  logistics  chain  impact  resource  migration.  Problem  definition,  model 
development,  and  conclusions  will  be  discussed. 

Optimization  of  Appointment  Systems 

Lt  Col  Peter  Vanden  Bosch,  PhD 

US  Air  Force 

36th  Electronic  Warfare  Squadron,  Eglin  AFB,  FL  32542-6867 
(850)  882-3027,  peter.vandenbosch@eglin.af.mil 

Appointment  systems  are  ubiquitous  throughout  DoD.  Application  of  this  research  includes  scheduling  related  to 
airfields,  just-in-time  loading  dock  operations,  cargo  ship  unloading,  and  personnel  appointment  systems.  Here,  appointment 
systems  are  modeled  as  a  finite  queuing  system  in  which  arrival  times  are  predetermined  and  service  time  distributions  are 
idd  and  phase-type.  Cost  is  defined  as  a  linear  combination  of  waiting  times  of  each  arriving  item  and  the  idle  time  (or 
overtime)  of  the  server.  This  work  shows  that  long-accepted  scheduling  heuristics  are  far  from  optimal,  and  it  provides 
precise  methods  for  evaluating  and  optimizing  the  cost  of  a  given  appointment  system.  I'll  also  describe  accurate  heuristics 
for  sequencing  arrivals,  a  critical  consideration  that  has  received  little  attention  in  the  literature.  The  research  also  provides  a 
lesson  for  us  as  to  when  to  reject  simulation  and  pursue  mathematical  modeling  instead. 

Determining  Inventory  Levels:  Do  we  have  the  right  criteria? 

MAJ  Sandra  L.  Vann-Oleiasz  CPT  Elizabeth  W.  Schott 

US  Military  Academy  US  Military  Academy 

ORCEN,  Department  of  Systems  Engineering  Department  of  Mathematical  Sciences 

West  Point,  NY  10996  West  Point,  NY  10996 

(845)  938-5168/5665,  sandv.vannoleiasz@us.armv.mil  (845)  938-4014,  elizabeth.schott@usma.edu 

Although  the  concepts  for  the  Army’s  Future  Combat  System  (FCS)  have  not  been  fully  developed,  one  of  the  premises 
of  the  Objective  Force  is  focused  logistics.  “Sustainability  in  a  full  spectrum  Army  will  require  a  combat  service  support 
reach  capability  that  allows  commanders  to  reduce  stockpiles  in  theater  while  relying  on  technology  to  provide  sustained 
velocity  management  and  real-time  tracking  of  supplies  and  equipment.  (FM  1).”  Historically,  tactical  stockage  levels  have 
been  largely  determined  by  demand  data.  This  presentation  will  examine  alternate  methods  for  determining  tactical  inventory 
policies. 
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Decision  Support  for  the  Career  Field  Matching  Process  at  USAFA 


Major  Andrew  P.  Armacost 

Assistant  Professor 
Department  of  Management 
USAF  Academy,  CO  80840 
719-333-8476,  FAX:  719-333-9715 
andy.armacost@usafa.af.mil 


Dr  James  K.  Lowe 
Associate  Professor 
Department  of  Management 
USAF  Academy,  CO  80840 
719-333-3122,  FAX:  719-333-9715 
jim.lowe@usafa.af.mil 


Matching  USAFA  cadets  to  their  initial  Air  Force  career  fields  is  time-consuming  and  largely  manual  process.  In  a 
previous  talk,  we  introduced  an  optimization-based  approach  that  determines  these  matchings,  given  known  cadet  job 
preferences,  cadet  standing  relative  to  their  peers,  and  AF  needs  within  each  career  field.  In  this  talk,  we  describe  a  suite  of 
models  that  supports  the  entire  process,  from  assigning  cadets  to  one  of  two  records-review  panels,  to  the  consolidation  of  the 
ranks  and  scores  generated  by  these  panels,  to  the  determination  of  AF  needs  for  each  career  field,  to  the  actual  matching  of 
cadets  to  career  fields.  This  suite  of  models  is  bound  together  using  a  simple  menu-drive  interface  that  enables  personnel 
officers  at  USAFA  to  operate  this  process  more  efficiently,  to  provide  cadets  with  better  assignments  to  their  initial  career 
fields,  and  to  meet  AF  accession  needs. 


CONLOG,  An  Application  of  Logistical  Regression  Analysis 

Ms.  Sandy  Bonnell,  GS-13  Dr.  Barry  Greengart,  GS-13 

9800  Savage  Road,  Suite  6675  9800  Savage  Road,  Suite  6675 

Fort  Meade,  MD  20755-6675  Fort  Meade,  MD  20755-6675 

443-479-5520,  301-688-9169  443-479-5520,  301-688-9169 

Bgreen633@erols.com 

CONLOG  is  an  important  tool  in  the  analysis  of  adverse  impact  against  demographic  groups  in  the  promotion  process,  or 
of  any  selection  process,  and  is  of  key  interest  in  diversity  management  and  Equal  Employment  Opportunity  (EEO)  concerns 
at  the  National  Security  Agency. 

CONLOG  is  an  application  of  logistical  regression  analysis  that  relates  the  probability  of  promotion  to  multiple  factors, 
which  can  include  qualifications  of  the  candidates  and  demographic  characteristics  as  well.  It  produces  regression  results  that 
relate  to  the  effect  of  each  factor  on  the  probability  for  promotion  with  “all  other  effects  being  equal.”  The  program  also 
produces  results  in  the  format  of  MULTEVENT  (an  objective  statistical  analysis  of  selections  for  promotion  by  demographic 
groups  based  on  a  “fair-share”  representation  of  each  demographic  group  in  the  eligible  population.)  Therefore,  CONLOG 
enhances  MULTEVENT  by  taking  qualifications  into  account.  This  is  important  in  the  analysis  of  the  effect  of  age  category 
in  promotions,  since  qualifications  are  more  important  in  this  type  of  analysis  than  in  the  analysis  of  race  and  gender. 

The  presenters  have  successfully  applied  CONLOG  to  promotion  selections  for  civilians  in  regards  to  age  category. 
Their  results,  as  well  as  the  data  analysis  behind  the  successful  application  of  CONLOG,  will  be  presented 


US  Army  Hispanic  Market  Analysis 


MAJ  Eric  Burger 

HQ  USAREC  Attn:  PAE 

Bldg  1307,3rd  Ave 

FT  Knox,  KY  40121 

(502)  626-0323  Fax:  (502)  626-0906 

eric.burger@usarec.armv.mil 


MAJ  Veronica  S.  Zsido 
HQ  USAREC  Attn:  PAE 
Bldg  1307,  3rd  Ave 
FT  Knox,  KY  40121 
(502)626-0341  Fax:(502)626-0906 
veronica.zsido@usarec.armv.mil 


This  presentation  will  discuss  the  U.S.  Army  Recruiting  Command's  goals,  as  well  as  the  Command's  strategy,  for 
recruiting  high  quality  young  men  and  women  from  the  "Hispanic  Market"  to  meet  the  needs  of  today's  Army  and  the  future 
Objective  Force.  The  briefing  will  address  collection  efforts  relating  to  population  demographics  data  and  recruiting 
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production  data;  provide  analytical  assessments  of  the  United  States  Army  recruiting  Command's  achievements  within  the 
Hispanic  Market  over  time  and  also  with  respect  to  other  DoD  services;  discuss  current  barriers  and  market  misperceptions; 
and  the  application  of  market  research  to  the  development  and  application  of  programs  and  initiatives  to  attract  applicants 
from  this  rapidly  expanding  recruiting  market.  The  goal  of  this  project  was  to  determine  through  analyses  the  most  effective 
method  to  target  our  recruiting  efforts  within  the  Hispanic  Market.  The  techniques  evaluated  during  this  project  included 
psychographic  and  demographic  profiling,  trend  analysis,  geo-coding  and  thematic  mapping.  The  presentation  is  designed 
for  those  interested  in  military  recruiting  challenges  presented  in  a  manpower  analysis  framework. 


The  Workforce  Projection  Model:  Design ,  Construct ,  Implementation  and  Model  Results 


Mr.  Charles  Chellis,  GS-14 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


Ms.  Laura  Billeter,  GS-13 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


Ms.  Mary  Filippell,  GS-15 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


Maryaurelia@mdo.net 

This  presentation  describes  the  development  and  design  of  a  model  designed  to  provide  the  Director,  National  Security 
Agency  and  his  deputy  directors  with  quantitative  information  regarding  his  civilian  workforce  over  varying  time  horizons. 
Analysts  from  the  Workforce  Assessment  Team  (WAT),  an  applied  Operations  Research  cell  within  the  Human  Resources 
department  at  the  National  Security  Agency,  created  this  workforce  projection  model  using  MS  Excel  and  populating  it  with 
data  retrieved  from  current  and  historical  personnel  files.  The  model  is  a  fractional-flow  Markov  model  that  steps  the 
workforce  through  time,  one  year  at  a  time,  hiring  and  attritioning  employees.  The  workforce  is  characterized  by  skill 
category,  Congressional  budgetary  program  element,  and  assigned  directorate.  The  model  beings  the  base  year  with  the 
starting  workforce  as  of  the  first  day  of  the  fiscal  year,  and  projects  to  the  time  horizon  requested  by  the  customer.  The  model 
uses  as  an  input  attrition  projections  from  another  model,  the  Attrition  Model.  The  Attrition  Model,  also  developed  and 
implemented  by  the  WAT,  is  an  entity-level  Markov  model  that  explicitly  models  attrition  to  great  detail. 

The  Workforce  Projection  Model  was  designed  to  be  extremely  flexible  and  allow  the  analysts  to  investigate  the  impact 
of  “what-if’  hiring  scenarios,  re-assignments  of  segments  of  the  workforce  from  one  directorate  to  another,  and  so  forth. 
Modules  were  written  into  the  model  to  perform  involuntary  separation  (Reduction  In  Force,  RIF)  and  outsourcing  of 
segments  of  the  civilian  workforce  (e.g.,  GROUNDBREAKER,  the  National  Security  Agency’s  outsourcing  of  the 
information  technology  infrastructure).  Model  results  are  intended  to  gauge  the  impact  of  these  various  scenarios  upon  the 
workforce  over  time.  Senior  management  uses  these  results  to  investigate  workforce  strategies  that  have  major  personnel  and 
financial  impacts. 

This  presentation  will  focus  on  the  development  and  design  of  the  Workforce  Projection  Model.  Results  from  the  model 
will  be  discussed,  and  its  implementation  in  MS  Excel.  Key  to  any  successful  model  is  the  data  that  populates  it.  Workforce 
data  will  be  displayed  and  its  structure  in  the  model  explained.  Results  from  the  model  will  be  discussed,  and  selected  “what- 
if’  scenarios  run  for  senior  management  will  be  presented. 


Student  Value  Model 


Ilia  Christman 

Navy  Personnel  Research  Studies  and  Technology 

PERS  -  1300  c/o  Tanja  F.  Blackstone 

5720  Integrity  Drive 

Milington,  TN  38002 

(703)  695  -  6424  nl3d@bupers.navv.mil 

Approved  abstract  unavailable  at  printing. 

Sailor  Career  Management:  Transforming  Navy  Personnel  Distribution  and  Assignment  through  the 
application  of  Collaborative  Intelligent  Software  Agents  and  Web-Based  Marketplaces 

Tony  Cunningham 

Navy  Personnel  Research  Studies  and  Technology 
PERS  -1300  C/O  Tanja  F.  Blackstone 
5720  Integrity  Drive,  Millington,  TN  38002 
Phone:  703-695-6424,  n  1 3d @bupers.navv.mil 

Existing  systems  do  not  meet  the  Navy’s  requirement  of  placing  the  right  Sailor/Marine  in  the  right  job  with  the  correct 
training  and  in  a  timely  fashion.  The  result  for  Navy  is  10,000  unfilled  sea  billets  with  the  resultant  manning  of  deploying 
ships  at  between  80  and  90%  of  required  manpower.  There  does  not  exist  an  incentives-based  rewards  system  that  entices 
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service  members  to  voluntarily  request  assignments  to  less  desirable  assignments.  This  results  in  these  jobs  experiencing 
continuous  manning  shortfalls.  No  process  exists  to  ensure  that  Sailors/Marines  are  guided  through  a  career  path  that  has 
proven  successful  for  professional  growth.  There  is  also  significant  distrust  and  dissatisfaction  in  the  current  processes  based 
on  the  element  of  human  intervention,  the  perception  of  favoritism  and  the  limited  number  of  choices.  Sailors  and  Marines 
today  spend  an  enormous  amount  of  time  -  away  from  their  primary  responsibilities,  attempting  to  gather  facts  about  new 
jobs  and  the  associated  information  regarding  the  geographic  area,  schools,  spouse  employment,  etc.  Even  with  several 
hundred  assignment  managers  involved  in  this  process,  the  information  most  frequently  sought  by  Sailors/Marines  is  at  best 
thorny  to  collate  and  frequently  unavailable. 

Unlike  previous  applications  of  intelligent  agents,  web-based  applications  and  reward  systems,  which  are  standalone,  we 
propose  a  solution  that  merges  these  multiple  components  into  an  integrated  career  management  system.  We  will  introduce 
collaborative  intelligent  software  agents  able  to  deliberate  into  the  distribution  and  assignment  process.  These  agents  will 
represent  the  interests  of  Sailors  and  Marines  and  USN/USMC  commands  and  activities.  The  agents  will  gather  critical 
information  for  use  in  job  matching,  career  mapping,  manpower  analysis,  personal  interests,  etc.  A  marketplace  environment 
will  be  employed  in  which  the  Sailor/Marine  agents  and  the  command  agents  will  search  out,  analyze,  negotiate  and 
consummate  optimum  job  matches  that  meet  the  personal  and  professional  needs  of  the  service  member  and  the  manpower 
needs  of  the  command  at  the  most  efficient  and  economical  costs.  Part  of  these  costs  will  include  the  various  assignment 
incentives  agreed  to  by  both  parties.  To  ensure  the  most  economical  use  of  limited  resources,  multiple  agents,  both 
individual  and  command,  will  “bid”  for  jobs  through  an  interactive  auction  mechanism.  With  the  use  of  agents,  it  is  expected 
that  virtually  all  “human”  assignment  managers  will  be  eliminated.  A  minimal  number  of  individuals  will  be  necessary  to 
adjudicate  intractable  cases.  Sailors/Marines  will  be  given  greater  control  over  their  assignments  and  commands  will  have 
the  opportunity  to  attract  the  types  of  individuals  needed  to  meet  their  manpower  requirements. 

We  expect  to  deliver  the  following  products  over  the  next  five  years:  Career  Case  Manager  (CCM)  technologies;  a 
Distribution  Incentive  System  (DIS);  Web-based  Marketplace  for  Sailors/Marines  and  Jobs;  and  the  integrated  Sailor/Marine 
Career  Management  System  (S/MCMS).  The  CCM  will  provide  single  point  of  reference  for  assignment,  education,  training, 
and  promotion  information  to  the  service  member  to  ensure  career  goals  are  attainable.  The  DIS  will  manage  the  equitable 
award  of  assignment  incentives  while  ensuring  adequate  incentive  levels  are  applied  to  difficult-to-fill  assignments.  The 
Web-based  Marketplace  for  Sailors/Marines  and  Jobs  will  serve  as  the  “virtual  mall”  where  service  members  and  commands 
will  search,  analyze,  negotiate  and  reach  agreement  on  optimal  assignments.  The  integrated  S/MCMS  will  merge  these 
products  into  a  single  focal  point  enabling  Sailors  and  Marines  to  manage  their  military  careers.  Significantly  less  time  will 
be  spent  searching  for  job  and  “chamber  of  commerce”  information  resulting  in  more  time  on  the  job  and  increased 
productivity.  Provided  with  relevant  job  information  with  which  to  make  informed  career  decisions,  Sailors  and  Marines  will 
be  more  likely  to  choose  to  remain  in  their  respective  service,  increasing  the  likelihood  of  retention  and  thereby  improving 
readiness  with  more  experienced  service  members. 

A  Comprehensive  Model  of  the  Employee’s  Turnover  Decision  Process 

Dr.  David  P.  Donnelly  Dr.  Jeffrey  J.  Quirin 

Professor,  Department  of  Accounting  Assistant  Professor 

Kansas  State  University  School  of  Accountancy 

Manhattan,  KS  66506  Wichita  State  University,  Wichita,  KS  67260 

Voice:  (785)-532-57 13,  Fax:  (785)-532-5959  Voice:  (316)-978-6258,  Fax:  (316)-978-3660 

Email:  dvdon@ksu.edu  Email:  ieffrev.quirin@wichita.edu 

Retaining  qualified  employees  is  a  substantial  element  of  the  military’s  human  resource  function.  The  long-term 
retention  of  employees  has  increased  in  importance  as  a  result  of  the  military’s  technological  modernization.  The  extensive 
high-cost  training  required  of  today’s  sailor  and  the  decrease  in  the  size  of  the  military’s  active  forces  have  made  long-term 
retention  critical  to  the  military  mission.  In  any  environment  in  which  retention  is  a  primary  goal,  an  essential  first  step  in 
controlling  attrition  is  the  development  of  an  in-depth  understanding  of  the  employee  turnover  decision  process.  The  current 
study  will  expand  the  body  of  knowledge  pertaining  to  the  turnover  decision  processes  followed  by  employees.  Specifically, 
the  Lee  and  Mitchell  [1994]  four-decision  path,  voluntary  turnover  model  will  be  tested.  The  decision  processes  of 
employees  that  quit  or  considered  quitting  their  jobs  in  the  last  year  will  be  compared  to  the  four  decision  paths  identified  in 
the  model.  It  is  posited  that  each  employee  included  in  the  study,  quitters  and  stayers  alike,  will  use  a  decision  process  that 
uniquely  matches  one  of  the  four  paths.  In  addition,  the  Lee  and  Mitchell  [1994]  model  will  also  be  extended  to  include 
economic  factors.  While  the  model  provides  a  framework  that  allows  researchers  to  examine  the  relation  between  decision 
paths  and  economic  factors,  prior  research  has  not  specifically  investigated  this  issue.  It  is  hypothesized  that  economic 
factors  are  associated  with  the  type  of  turnover  decision  processes  chosen  by  employees.  A  sample  of  50  people  who  have 
quit  their  jobs  within  the  past  year  and  50  people  who  have  considered  quitting  but  ultimately  made  the  decision  to  remain 
employed  will  be  used  to  test  the  model.  Data  collected  to  date  are  supportive  of  the  proposed  hypotheses.  They  also  suggest 
that  economic  consequences  play  an  important  role  in  certain  situations  and  specific  types  of  decision  processes. 
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Analysis  of  DOD’s  Civilian  Personnel  Issues 
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US  General  Accounting  Office 
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DOD  is  a  “total  force”  composed  of  active  and  reserve  military  personnel,  civil  service  and  other  civilian  employees,  and 
contractor  personnel.  Compared  to  the  analyses  of  military  personnel  issues,  relatively  little  attention  has  been  given  to 
civilian  or  “total  force”  issues.  Further,  a  decade  of  downsizing  has  left  DOD  facing  human  capital  challenges  that  mirror 
those  facing  the  rest  of  government,  but  are  comparatively  massive  in  terms  of  scope  and  budgetary  implications.  How  can 
the  analytic  community  help  DOD  in  its  strategic  management  of  human  capital-designated  by  GAO  as  a  high-risk  area 
government-wide — especially  civilian  personnel?  Specifically,  what  are  the  issues  in  assessing  DOD’s  human  capital 
strategic  planning,  organizational  alignment,  leadership,  talent,  and  performance  culture — the  five  parts  of  GAO’s  human 
capital  self-assessment  framework? 

Developing  Aerospace  Leaders  (DAL)  Development  Tool 

Lt  Col  Jennifer  Graham 

USAF/DP  DAL 

1811  South  Clark  Place  CP-4,  Suite  910 
Arlington,  VA  22244 

703-604-1333,  Fax:  703  604-1358,  iennifer.graham@pentagon.af.mil 

The  DAL  Development  Tool  (DAL-DT)  is  a  critical  element  of  the  change  that  DAL  brings  to  the  Air  Force.  Built  upon 
the  Global  Combat  Support  System-Air  Force  (GCCS-AF)  architecture,  DAL-DT  will  be  an  automated  information  system 
that  supports  the  DAL  construct  Air  Force-wide.  It  emphasizes  “self-service”  human  resources,  improves  efficiency,  and 
reduces  costs  by  empowering  the  workforce,  including  commanders  and  Air  Force  personnel  themselves,  to  interact  with  the 
system  at  multiple  levels.  DAL-DT  will  be  the  Air  Force  standard  architecture  for  integration  of  Human  Resources 
Information  Technology. 

The  DAL  DT  demonstration  not  only  provides  the  vision  for  the  IT  capability  but  also  outlines  the  new  methodology  the 
Air  Force  will  be  using  in  requirements  definition  and  personnel  management. 

MULTEVENT,  A  Statistical  Analysis  of  Adverse  Impact  Against  Demographic  Groups  for  any 
Selection  Purposes 

Dr.  Barry  Greenqart,  GS-13  Ms.  Sandy  Bonnell,  GS-13 

9800  Savage  Road,  Suite  6675  9800  Savage  Road,  Suite  6675 

Fort  Meade,  MD  20755-6675  Fort  Meade,  MD  20755-6675 

443-479-5520,  301-688-9169;  Bgreen633@erols.com  443-479-5520,  301-688-9169 

MULTEVENT  is  an  important  tool  in  the  analysis  of  adverse  impact  against  demographic  groups  in  the  promotion 
process,  or  any  selection  process,  and  is  of  key  interest  in  diversity  management  and  Equal  Employment  Opportunity  (EEO) 
concerns. 

The  MULTEVENT  procedure  provides  an  objective  statistical  analysis  of  selections  for  promotion  by  demographic 
groups  based  on  a  “fair-share”  representation  of  each  demographic  group  in  the  eligible  population.  If  the  proportional 
representation  of  those  promoted  from  a  particular  demographic  group  is  much  higher  than  would  be  expected  based  on  the 
eligible  population,  then  the  promotion  results  are  designated  as  significantly  positive,  and  that  demographic  group  is  said  to 
be  over-represented.  Similarly,  if  the  proportional  representation  of  a  demographic  group  is  much  lower  than  expected,  the 
results  are  significantly  negative,  the  group  is  said  to  be  under-represented. 

MULTEVENT  is  an  application  of  the  Fisher’s  Exact  Test,  and  shows  the  probability  of  the  deviations  from  the 
expected  “fair-share”  value.  For  example,  if  the  probability  of  the  actual  number  of  selections  for  a  demographic  group  is  less 
than  5%  under  the  assumption  of  a  fair-share  representation,  this  would  be  a  significant  deviation  and  would  indicate  that 
there  may  be  underlying  factors,  or  perhaps  discrimination,  which  could  explain  the  demographic  group’s  under¬ 
representation.  This  would  be  an  indication  for  more  investigation  by  EEO  organizations. 

The  presenters  have  successfully  applied  MULTEVENT  for  many  years  to  promotion  selections  for  civilians  in  regards 
to  demographic  characteristics  of  race  and  gender.  A  significant  portion  of  the  successful  application  of  this  procedure  was 
the  accurate  capturing  of  data,  and  the  stratification  of  the  data  into  skill  category  and  grade  level  data  sets.  Their  results  will 
be  presented. 
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Improving  Selective  Reenlistment  Bonus  (SRB)  Allocation  Procedures  in  the  Army 


Peter  Greenston 
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SAG  Corporation 
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pmackin@sagcorp.com 


This  study  developed  and  estimated  a  new  model  of  Army  enlisted  retention  behavior,  with  particular  emphasis  on  the 
responsiveness  of  retention  to  changes  in  the  SRB  program.  A  two-choice  Annualized  Cost  of  Leaving  (ACOL)  framework 
was  applied  to  estimate  retention  effects  for  soldiers  making  stay/leave  decisions  in  Zones  A,  B  and  C.  Historical  data  for 
fiscal  years  1990  through  2000  was  used  for  the  estimation. 

The  analysis  explored  differences  across  skills  and  provides  quantitative  evidence  that  can  be  directly  applied  to  support 
the  formulation  of  SRB  policy.  The  project  also  included  the  development  of  a  prototype,  spreadsheet-based  analytical  tool 
that  allows  Army  program  managers  to  apply  the  research  results  to  allocate  SRB  resources  efficiently. 


Considering  Applicant  Interests  in  Initial  Classification:  The  Development  of  fob  and  Occupational 
Interest  in  the  Navy  (JOIN). 


Regina  L.  Hindelanq 

Navy  Personnel  Research  Studies  and 
Technology,  PERS-1300 
5720  Integrity  Dr,  Millington,  TN 
38002;  (901)  874-4655 


Paul  G.  Micheal 

Navy  Personnel  Research  Studies  and 
Technology,  PERS-1300 
5720  Integrity  Dr,  Millington,  TN 
38002;  (901)  874-4655 


Stephen  E.  Watson,  Ph.D. 

Navy  Personnel  Research  Studies  and 
Technology,  PERS-1300 
5720  Integrity  Dr,  Millington,  TN 
38002;  (901)  874-4655 


Empirically,  job  performance,  employee  satisfaction,  and  employee  retention  are  contingent  upon  appropriately 
matching  recruits  with  their  desired  occupation.  The  costs  associated  with  losses  in  productivity  and  personnel  can  be 
astronomical.  In  an  effort  to  minimize  attrition  and  dissatisfaction  among  Navy  personnel.  Navy  researchers  have  focused  on 
the  development  of  an  inventory  that  can  inform  applicants  about  activities  and  work  environments  in  the  Navy,  and  measure 
the  applicant's  interest  in  these  activities  and  environments. 

A  new  measure  of  vocational  interest.  Job  and  Occupational  Interest  in  the  Navy  (JOIN),  is  being  developed  for  use  in 
conjunction  with  a  new  set  of  job  matching  algorithms,  the  Rating  Identification  Engine  (RIDE),  to  help  provide  a  better 
match  between  recruits  and  specific  occupations  (i.e.  ratings).  It  is  hypothesized  that  the  simultaneous  utilization  of  the  JOIN 
interest  measure  and  the  RIDE  ability  components  will  improve  the  match  between  the  Navy  recruit's  abilities  and  interests, 
an  ultimately  serve  as  a  means  of  increasing  job  satisfaction,  performance,  and  retention,  while  decreasing  first  term  attrition. 
Current  efforts  have  focused  on  developing  a  rational,  conceptual  model,  guided  by  psychological  literature,  and  a  series  of 
Subject  Matter  Expert  (SME)  interviews.  The  presentation  will  focus  on  the  conceptualization,  development  and  proposed 
validation  of  the  JOIN  model. 


Army  Advertising  LEADS  Prioritization  Analysis 


MAJ  Thomas  Liuzzo 

HQ,  USAREC  ATTN:  PAE 
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dixon.dvkman@usarec.armv.mil 


This  presentation  will  discuss  the  problem,  data  preparation,  experimental  design,  modeling  effort  and  results  of  the 
United  States  Army  Recruiting  Command's  advertising  leads  prioritization  analysis.  The  goal  of  this  project  was  to 
determine  the  most  effective  method  to  prioritize  the  quality  of  an  advertising  lead  in  terms  of  the  likelihood  to  enlist  in  the 
United  States  Army.  The  techniques  evaluated  during  this  analysis  included  logistic  regression,  polynomial  statistical 
networks,  K-nearest  neighbor,  classification  and  regression  trees  (C&RT)  and  neural  networks.  The  presentation  will  also 
highlight  the  differences  in  output  between  the  various  modeling  techniques  and  methods  of  deploying  the  results  for 
improved  efficiency  in  recruiting  operations  and  advertising  practices.  The  presentation  is  designed  for  those  interested  in 
using  advanced  modeling  and  data  mining  techniques  for  problem  solving. 
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Douglas  M.  Matty 

Dept,  of  Math.  Sciences 
West  Point,  NY  10996 
(845)  938-5616,  Fax:  (845)  938-2409 
ad8780@usma.edu 

Biannually,  an  Army  proponent  must  brief  the  Army’s  leadership  on  the  state  of  the  branch.  This  briefing  is  called  the 
Functional  Review.  Most  proponents  are  not  supported  by  organic  analytical  assets.  Through  outreach  efforts,  strategic 
personnel  strength  management  techniques  were  applied  to  support  the  Air  Defense  Artillery’s  Functional  Review.  The 
results  adjusted  the  current  perceived  status  and  identified  strategic  trends  to  generate  alternatives  for  the  direction  of  the 
branch  in  the  near  and  far  terms. 


The  Attrition  Model 


Mr.  Andrew  McCabe,  GS-13 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


Mr.  Tyler  Faloon,  GS-13 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


Admccab@aol.com 

The  presenters  designed,  developed  and  now  exercise  an  Attrition  Model  on  behalf  of  senior  management  at  the  National 
Security  Agency.  The  model  is  Markovian  based,  that  was  developed  in  the  spring  of  1996  to  better  understand  and  then 
forecast  how  the  early-out  and  incentives  offered  to  Agency  civilian  employees  would  affect  attrition  figures  and  help  the 
Agency  achieve  its  downsizing  goals.  The  model  has  been  in  use  consistently  since  1996,  with  the  presenters  making 
significant  enhancements,  updates  to  accurately  reflect  changes  in  the  Agency,  and  calibration  of  underlying  transition  figures 
over  this  time  period.  The  model’s  accuracy  has  been  fairly  good  when  early-out  and  incentive  programs  offered  to  Agency 
civilians  have  remained  constant. 

The  Attrition  Model  incorporates  the  Agency  full-time  civilian  population  to  the  entity  level  and  uses  historical  attrition 
rates  to  project  how  many  individuals  will  leave  Agency  service  in  a  given  time  period.  The  model  calculates  regular  and 
early  retirement  based  on  the  attributes  of  age  and  years-of-service  as  these  are  the  primary  factors  involved  in  an  individual’s 
retirement  decision.  Resignation,  on  the  other  hand,  is  tied  more  closely  to  an  individual’s  skill  field;  therefore  the  model 
makes  resignation  projections  based  on  occupational  codes  and  age.  The  model  is  best  used  as  a  predictor  of  overall  Agency 
attrition  expectations,  but  has  been  use  at  lower  level  of  analysis  for  organizations  and  groups. 

The  Attrition  Model  and  its  results  will  be  presented. 


Development  of  a  Strategic  Recruiting  Research  Roadmap 

Mark  Robershotte 

Pacific  Northwest  National  Laboratory 
902  Battelle  Blvd. 

P.O.  Box  999 

Richland,  WA  99352 

(509)  372  -  4849  Fax:  (509)  372-6255 

mark.robershotte@pnl.gov 


PNNL  was  asked  to  develop  a  strategic  recruiting  research  roadmap  for  the  US  Army  Recruiting  Command  (USAREC) 
to  help  reestablish  and  manage  recruiting  research.  The  roadmap  development  was  built  on  the  USAREC  Campaign  Plan 
Strategic  Plan,  and  Strategic  Objectives  and  incorporates  and  expands  upon  the  Recruiting  Research  Consortium  Model. 
Recent  military  and  civilian  recruiting  research  was  reviewed  primarily  to  determine  research  knowledge  gaps  that  warranted 
research  to  provide  the  critical  research  information  necessary  to  effectively  support  the  recruiting  needs  of  the  Army.  This 
paper  provides  specific  research  recommendations,  the  associated  rationale,  and  includes  a  decision  process  for 
comprehensive  strategic  recruiting  roadmap  with  the  detailed  decision  points  overlaid  upon  the  annual  funding  cycle. 
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Arlington,  VA  22202-5050 
703-413-1100,  ext.  5240  Fax:  703-413-811 1 
Margaret  Harrell@rand.org 


Officer  manpower  gaps,  to  include  deltas,  differences,  and  mismatches  between  authorizations  and  inventory,  occur 
throughout  the  Navy,  in  various  patterns  across  different  communities  and  in  different  grades.  Given  the  dollar  costs  as  well 
as  the  soft  costs  (such  as  performance,  capability,  and  readiness)  resulting  from  such  gaps,  we  assert  that  communities  must 
be  managed  independently,  systemically,  and  to  authorizations  in  order  to  prevent  such  gaps.  We  have  developed  a  system 
dynamics  model  to  explore  the  dynamic  relationships  between  officer  management  policies.  Within  the  model,  promotion 
rates,  promotion  timing,  longer  careers  and  other  management  decisions  are  dynamically  linked  for  Navy  communities.  This 
presentation  briefly  describes  the  model,  elaborates  upon  the  dynamic  interaction  between  management  policies,  and  explores 
the  likely  differences  in  managing  selected  Navy  communities  should  the  Navy  decide  to  manage  officers  to  authorizations. 


Assessing  the  Impact  of  PERSTEMPO  Legislation  on  the  Marine  Corps 


Mr.  Andrew  C.  Thompson 
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In  August  2001  the  FY02  Marine  Corps  Studies  Board  called  for  a  study  to  determine  the  impact  of  the  FY01  National 
Defense  Authorization  Act  PERSTEMPO  legislation  on  the  Marine  Corps.  This  legislation  provides  for  a  $100  per  day  high 
deployment  per  diem  (HDPD)  payment  to  any  Marine  deployed  in  excess  of  400  of  the  preceding  730  days.  Studies  and 
Analysis  Division,  Marine  Corps  Combat  Development  Command  was  tasked  to  estimate  the  burden  of  HDPD  to  the  Marine 
Corps,  propose  actions  that  could  reduce  HDPD  costs,  and  explain  potential  effects  of  those  actions.  A  literature  review 
identified  many  theories  describing  personnel  tempo  but  little  real  data.  Due  to  this  lack  of  data  a  baseline  model  was 
developed  in  Excel  that  estimated  PERSTEMPO  from  unit  operations  tempo  (OPTEMPO)  profiles.  The  baseline  model 
evolved  into  a  collection  of  unit  specific  sub-models  due  to  variation  in  OPTEMPO  across  unit  types.  This  composite  model 
was  used  to  examine  the  impact  of  training  and  deployment  schedules  on  the  overall  Marine  Corps’  HDPD  cost.  A  Monte 
Carlo  simulation  model  of  an  individual  PERSTEMPO  profile  was  also  constructed  to  assess  the  detailed  effects  of  several 
proposed  courses  of  action.  This  presentation  will  describe  the  analytical  approach  of  the  PERSTEMPO  models  and  how 
they  were  employed  to  meet  the  study  objectives.  These  models  provide  a  valuable  environment  for  evaluating  courses  of 
action  to  reduce  HDPD  costs  while  maintaining  unit  readiness  and  retention  rates. 


The  Status  of  Navy  and  Army  Recruiter  Productivity 
Gary  Ton 

Navy  Recruiting  Command 
5722  Integrity  Drive,  Bldg.  784 
Millington,  TN  38054 
(901)  874-9322  Fax:  (901)  874-9327 
tong@cnrc.navy.mil 

This  presentation  will  provide  a  statistical  review  of  recruiter  productivity  for  the  Navy  and  Army  for  the  last  24  months. 
It  is  apparent  that  each  service  has  its  own  philosophy  when  it  comes  to  recruiter  productivity.  What  are  the  major 
differences  between  them?  Is  it  the  systems  that  they  use,  geographical  challenges  they  face  ,  or  something  else?  First,  we 
will  address  their  individual  recruiting  process  and  summarize  the  inter-service  differences.  Key  resource  will  be  examined 
and  competitive  advantages  determined.  Next,  a  comparative  analysis,  using  some  external  criteria  from  private  industry, 
will  make  an  assessment  on  the  recruiter  productivity  for  each  service.  Using  techniques  such  as  multiple  regression,  T-Test, 
and  ANOVA,  a  comprehensive  analysis  will  evaluate  the  primary  measures  of  effectiveness  for  each  service. 
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This  presentation  focuses  on  the  conceptualization,  development,  testing,  and  refinement  of  the  RIDE  ability  model.  The 
RIDE  project  utilizes  ideas  from  psychology,  education,  economics  and  operations  research  to  create  a  set  of  algorithms 
which  can  help  guide  Sailor-Applicants  to  Program/Ratings.  By  guiding  our  research  with  empirically-established  models  of 
human  behavior,  our  goal  is  to  develop  RIDE  as  an  intuitive  and  accurate  model  of  match  between  the  Sailor's  abilities  and 
interests  and  the  rating's  requirements  and  features.  By  establishing  a  good  applicant-ability  to  job-requirements  match 
between  the  Applicant-Sailor  and  the  Program/Rating,  we  can  minimize  the  number  of  unfilled  jobs  for  the  fiscal  year  due  to 
over-qualification  wastage,  and  maximize  training  success  in  the  fiscal  year. 


The  Evil  of  Model  Complexity 


Dr.  Steven  P.  Wilcox 

Northrop  Grumman  Information  Technology 
2100  Washington  Boulevard,  Arlington,  VA  22204 
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swilcox@northropgrumman.com 
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Complexity  in  manpower  models  is  attractive  in  that  it  potentially  allows  greater  model  fidelity,  validity,  and  analytical 
or  predictive  power.  However,  there  are  also  drawbacks.  Complexity  can  result  in  the  evils  of  long  run  times,  unwieldy 
software,  greater  opportunity  for  model  error,  and  even  a  reduction  in  predictive  accuracy.  In  this  tutorial  we  will  examine 
how  model  complexity  arises  in  the  application  of  important  manpower  modeling  techniques,  illustrate  how  it  creates 
problems,  and  discuss  how  to  manage  it. 


US  Army  College  Market  Analysis 
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This  presentation  will  discuss  the  United  States  Army  Recruiting  Command's  goals,  as  well  as  the  Command's  strategy, 
for  recruiting  high  quality  young  men  and  women  from  the  "College  Market"  to  meet  the  needs  of  today's  Army  and  the 
future  Objective  Force.  The  briefing  will  define  the  term  "College  Market";  address  collection  efforts  relating  to  institutional 
data  population  demographic  data,  and  recruiting  production  data;  provide  analytical  assessments  of  the  United  States  Army 
Recruiting  Command's  achievements  within  the  College  Market  over  time  and  also  with  respect  to  other  DOD  services; 
discuss  current  barriers  and  market  misperceptions;  and  project  future  achievement  within  this  lucrative  recruiting  market. 
The  goal  of  this  project  was  to  determine  through  analyses  the  most  effective  method  to  target  our  recruiting  efforts  within 
the  College  Market.  The  techniques  evaluated  during  this  project  included  psychographic  and  demographic  profiling,  trend 
analysis,  geo-coding,  and  thermatic  mapping.  The  presentation  is  designed  for  those  interested  in  military  recruiting 
challenges  presented  in  a  manpower  analysis  framework. 
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The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 

Issues  Related  to  DOD’s  Difficulty  in  Correcting  Unified  Commanders  Readiness  Deficiencies 

Mr.  Rodell  Anderson  Mr.  Steve  Stienlieb 

U.S.  General  Accounting  Office  U  S.  General  Accounting  Office 

Washington  D.C.  Washington  D.C. 

(202)  512-8091  (202)  512-4534 

andersonr@gao.gov  stemliebs@gao.gov 

Since  the  mid- 1 990’ s,  the  Joint  Chiefs  of  Staff  have  validated  a  number  of  significant  readiness  deficiencies  of  the 
Unified  Commands  that  limit  these  warfighters’  ability  to  effectively  synchronize  and  use  their  forces  to  meet  national 
objectives.  These  deficiencies  include  shortages  of  intelligence,  surveillance,  and  reconnaissance  platforms;  intelligence 
personnel;  command,  control,  communication  and  computer  systems;  and  information  security. 

While  most  of  these  issues  have  been  raised  for  a  number  of  years,  there  has  been  little  success  in  correcting  most  of 
them.  For  some  issues,  it  has  taken  several  years  to  assess  the  problem  and  consider  potential  solutions.  Even  after  a  solution 
has  been  identified,  it  is  often  projected  to  take  several  years  to  fully  field  the  equipment  or  personnel  needed.  For  other 
issues,  it  has  been  determined  that  partially  correcting  deficiencies  is  an  acceptable  risk  since  fully  corrected  has  been  deemed 
to  be  unaffordable.  While  some  of  these  issues  will  require  multiple  billion  dollar  expenditures,  neither  DOD  nor  the  Joint 
Staff  have  identified  the  total  cost  to  correct  all  deficiencies. 

American  Industrial  War  Readiness 

Mr.  Michael  A.  Bressler 

Army  Air  Defense  Artillery  Directorate 
1660  Jeb  Stuart  Road 
Ft.  Bliss,  TX  79916-6816 
(915)568-2185 
bresslermichael  @otc.  army,  mil 

The  Vietnam  took  a  heavy  toll  on  the  psychology  of  the  American  armed  forces.  In  the  early  1980's  and  as  part  of  the 
Army's  soul  searching  process  an  exhaustive,  confidential  Army  survey  had  been  conducted  among  its  officers  and  senior 
leaders.  The  1985  published  report  only  confirmed  what  many  knew  to  be  a  profound  spiritual  loss  among  our  soldiers  and 
what  it  would  take  to  revive  it. 

The  survey  was  ordered  by  the  then  Chief  of  Staff,  General  John  Wickham,  with  an  introductory  letter  stating:  "  Because 
this  study  will  shape  the  future  of  our  officer  corps,  we  need  your  candid  opinions..."  The  survey  report  was  compiled  from 
answers  to  two  long  questionnaires.  The  first  was  sent  to  all  436  serving  officers  in  the  four  grades  of  general,  of  whom  333 
(or  77%)  replied;  the  second  was  sent  to  23,000  randomly  selected  officers  (from  colonel  to  lieutenant)  of  whom  14,046 
replied  (or  62%).  In  those  six  grades  were  a  total  of  92,000  officers.  Three  of  the  many  results  tabulated  were: 

•  Sixty-eight  percent  agreed  that,  ” the  officer  corps  focused  on  personal  gain  rather  than  selflessness  " 

•  Among  the  general  officers  nearly  one  half  concluded  that,  "senior  Army  leaders  behave  too  much  like  corporate 
executives  and  not  enough  like  warriors" 

•  Fifty  percent  of  the  officers  agreed  that,  "the  bold,  original  creative  officer  cannot  survive  in  today's  Army " 

One  of  the  fallout's  from  this  disquieting  revelation  was  a  major  exodus  of  talented  people  into  civilian  life.  But  where 
did  they  go?  Who  did  they  work  for?  What  energies  of  innovation  and  imagination  were  lost  to  private  enterprise?  We  will 
never  know  exactly,  of  course,  but  there  may  be  a  way  of  harnessing  future  officers  who  leave  active  duty  by  offering  an 
alternative  Reserve  Officer  career  program  aimed  at  a  selected  reservists  who  find  themselves  in  responsible  positions  in 
industry  as  Vice  Presidents  or  even  Chief  Executive  Officers. 

How  to  design  a  possible  career  path  and  what  it  might  mean  to  defense  industrial  readiness  and  now,  perhaps,  industrial 
security  will  be  the  theme  of  this  paper. 

The  paper  has  two  parts:  first,  a  discussion  on  the  defense  industrial  readiness  crisis  of  the  early  1980's  and  how  an 
industrial  -  reserve  career  program  might  have  worked  examining  the  fighter  aircraft  industry  as  an  example.  The  second  part 
will  focus  on  a  modern  appraisal  of  the  defense  industry  and  how  a  reserve  career  program  might  work  and  be  expanded  to 
support  special  needs  of  homeland  security. 
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O&M  Program  Balance  Metrics  and  Links  to  Forces  Readiness 

Mr.  Daniel  L.  Cuda 

Institute  for  Defense  Analyses 
4850  Mark  Center  Dr. 

Alexandria,  V A  22311-1882 
(703)  578-2770,  dcuda@ida.org 

Operations  and  Maintenance  (O&M)  funding  is  a  clear  driver  of  current  unit  readiness.  Despite  this  consensus  opinion, 
few  metrics  have  been  developed  within  the  O&M  budgeting  process  to  aid  the  evaluation  of  funding  adequacy.  Preliminary 
research  is  underway  to  identify  O&M  budget  metrics  using  data  submitted  within  the  PPBS  process.  This  presentation 
introduces  a  budgetary  taxonomy  for  O&M  Sub-Activity  Groups  (SAG)  now  in  use  within  the  Office  of  the  Secretary  of 
Defense,  and  presents  broad  initial  metrics  designed  aid  the  evaluation  of  O&M  budget  estimates  at  the  Service  Component 
level. 

Control  Charts  for  Navy  Cruise  Metrics 

Dr.  Chris  Duquette 

Director,  Navy  Training  and  Education  (N79) 

2000  Navy  Pentagon 

Washington  DC,  DC  20350-2000 

(703)  602-5166,  Duauette.Chris@hq.navv.mil 


USS  Harry  S  Truman  (CVN-75),  with  air  wing  CVW-3  embarked,  deployed  from  November  2000  through  May  2001  to 
the  Arabian  Gulf  in  support  of  Operation  Southern  Watch  (OSW)  and  maritime  intercept  operations  (MIO).  Four  months 
were  spent  in  the  Gulf  -  from  the  beginning  of  January  through  the  end  of  April  -  the  longest  Gulf  stint  of  any  recent 
carrier/air  wing  cruise.  All  cruise  long,  key  metrics  covering  the  air  wing’s  sortie-generation,  readiness,  and  maintenance 
were  tracked  relative  to  control  charts  generated  from  historic  data.  Each  week,  the  charts  were  updated  and  forwarded  to 
key  players  attached  to  the  carrier,  the  air  wing,  and  the  battle  group  commander’s  staff.  Ultimately  they  made  their  way 
each  week  to  Commander,  Carrier  Group  TWO  -  RADM  James  “JMAC”  McArthur. 

The  control  charts  provided  a  standard  for  comparison  where  none  had  existed  before.  For  example,  during  a  cruise  air 
wing  readiness  isn’t  flat  -  it  follows  a  distinct  bowl-shaped  pattern  (one  could  even  call  it  a  “bathtub”)  of  starting  off  high 
with  the  fly-on,  bottoming  out  at  the  mid-cruise  steady-state,  and  ramping  back  up  for  the  end-of-cruise  fly-off.  The  control 
charts  capture  that  cruise  pattern  and  represent  an  informative  way  to  track  the  metrics.  For  most  of  the  metrics,  HST/CVW- 
3  operated  within  the  parameters  set  by  earlier  deployments.  A  few  metrics  had  HST/CVW-3  pushing  the  bounds  to  improve 
upon  the  historic  averages. 


Readiness  and  the  Ability  of  US  Forces  to  Train  Overseas 


Ms.  Laura  Durland 

U.S.  General  Accounting  Office 
GAO  Atlanta  Field  Office 
Atlanta,  GA 

(404)  679-1838,  durlandl@gao.gov 


Mr.  Steve  Stienlieb 

U.S.  General  Accounting  Office 

Washington  D.C. 

(202)512-4534 

sternliebs@gao.gov 


US  military  units  based  overseas  face  a  variety  of  constraints  from  host  governments  that  are  making  it  increasingly 
difficult  for  them  to  train.  They  have  the  most  difficulty  meeting  their  training  requirements  for  large  maneuver  operations, 
live  ordnance  practice,  and  night  and  low  altitude  flying.  The  consequences  of  the  constraints  include  (1)  training 
deployments,  (2)  a  lack  of  realism  in  some  of  the  training,  and  (3)  not  being  able  to  complete  all  necessary  training. 

While  these  issues  are  frequently  discussed  among  unit  personnel,  these  affects  are  not  readily  apparent  in  readiness 
reporting.  In  fact,  there  appears  to  be  a  disconnect  between  the  inability  of  units  to  complete  required  training  and  a 
degradation  in  reported  readiness.  At  the  same  time  the  consequence  of  this  practice  undermines  the  usefulness  of  readiness 
reporting.  Therefore,  senior  DOD  leadership,  such  as  the  Senior  Readiness  Oversight  Council,  may  be  unaware  of  the 
adverse  impact  of  training  limitation  in  making  strategic  decisions. 
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Supplemental  Metrics  for  Navy  Supply  and  Maintenance 

Mr.  S.  Craig  Goodwyn  Dr.  Peter  J.  Francis 

Center  For  Naval  Analyses  Center  For  Naval  Analyses 

4825  Mark  Center  Drive,  Alexandria,  VA  22311  4825  Mark  Center  Drive,  Alexandria,  VA  22311 

(703)  824-2422,  goodwyns@cna.org  (703)  824-2094,  francisp@cna.org 

Traditionally,  the  Navy  has  relied  on  metrics  based  on  downtimes  due  to  supply  and  downtimes  due  to  maintenance  to 
detect  supply  and  maintenance  problems.  Based  on  an  examination  of  maintenance,  supply,  and  flight  data,  we  have 
concluded  that  these  metrics  have  hidden  tremendous  fluctuations  in  the  amount  of  time  awaiting  parts  and  have  overstated 
the  amount  of  downtime  due  to  maintenance.  We  have  therefore  concluded  that  the  standard  NMCS/PMCS  and 
NMCM/PMCM  are  not  good  indicators  for  problems  in  their  respective  areas.  As  an  alternative,  we  recommend  that  total 
elapsed  maintenance  times  and  what  we  call  total  primary  maintenance  hours  be  used  to  flag  maintenance  problems. 
Similarly,  total  maintenance  action  supply  hours  and  fill  rates  should  be  used  to  identify  supply  problems. 

Air  Force  Deployment  Requirements  Determination 

Lt.  Sara  E.  Grossman,  USAF  Major  David  S.  Clements,  USAF 

Air  Force  Manpower  Readiness  Flight  Air  Force  Manpower  Readiness  Flight 

200  Beasley  Drive,  Suite  100  200  Beasley  Drive,  Suite  100 

Fort  Detrick,  MD  21702-5029  Fort  Detrick,  MD  21702-5029 

(717)  878-3138,  S ar a . Grossman @ penta gon . af . mi  1  DSN  988-2478,  David.clement@pentagon.af.mil 

A  Timed  Phase  Force  Deployment  Data  (TPFDD)  identifies  the  specific  forces,  functional  support  and  resources 
required  to  execute  the  plan  and  provide  closure  estimates  for  their  movement  (JOPES,  Vol  I).  Ideally,  this  information 
serves  as  a  record  of  the  count  of  manpower  deployment  requirements.  In  the  case  of  Operation  Enduring  Freedom,  the  Air 
Force  is  using  this  data  to  help  determine  its  requirement  for  deploying  forces.  Alternatively,  the  deployed  personnel  data 
gives  the  AF  a  record  of  personnel  at  the  deployed  location,  counted  as  they  arrive  in  theater.  Analysis  shows  the 
deployment  requirements  as  listed  in  the  TPFDD  do  not  align  with  the  deployed  personnel.  This  leads  to  the  question  -  what 
is  the  true  requirement  for  the  Air  Force  -  the  document  that  requests  troop  movements  as  determined  by  the  CINC  (the 
TPFDD),  or  the  number  of  personnel  that  have  actually  deployed  and  are  fighting,  and  winning,  a  war?  This  analysis  shows 
that  pure  TPFDD  numbers  are  potentially  overstated,  and  should  be  used  only  with  discretion  for  simulations,  studies,  and 
analyses.  In  addition,  we  offer  our  own  process  for  assessing  the  TPFDD  and  producing  a  more  accurate  statement  of  the 
deployed  manpower  requirement. 

Improving  Readiness  through  Accurate  Spare  Parts  Industrial  Base  Capability  Assessments 
Ms.  Leslie  Gregor  Mr.  Paul  Gvoth 

U  S.  GAO,  5029  Corporate  Woods  Drive,  #300  U.S.  GAO,  5029  Corporate  Woods  Drive,  #300 

Virginia  Beach,  VA  23462  Virginia  Beach,  VA  23462 

(757)  552-8153,  gregorl@gao.gov  (757)  552-8153,  gvothp@gao.gov 

Department  of  Defense  policy  calls  for  each  of  the  services  to  plan  for  and  provide  sufficient  war  materiel  to  commence 
execution  of  expected  war  scenarios.  To  achieve  this  state  of  readiness,  the  services  can  plan  for  spare  parts  to  be  available 
from  peacetime  operating  stocks,  war  reserve  inventories,  or  from  the  industrial  base.  DOD’s  policy  is  to  rely  on  the 
industrial  base  to  the  maximum  extent  possible.  War  planners  need  accurate  assessments  as  to  when  spare  parts  will  be 
available  from  the  industrial  base  during  wartime  so  that  they  can  estimate  the  amount  of  war  reserve  material  that  needs  to 
be  bought.  Inaccurate  or  insufficient  industrial  base  capability  estimates  cause  war  planners  to  reduce  their  risk  of  running 
out  of  parts  by  increasing  war  reserve  inventories.  Recently,  Congress  has  shown  a  willingness  to  fund  war  reserve  spare 
parts  inventories,  which  further  emphasizes  the  need  for  accurate  industrial  base  capability  assessments.  We  will  discuss 
industrial  base  capability  assessment  methodologies  and  their  potential  impact  on  readiness  and  budgets. 

Analyzing  Anti-Terrorist  Tactical  Effectiveness  for  Force  Protection  using  X3D  Graphics  &  Agent- 
Based  Simulation 


Lt.  James  Harney.  USN  and  Mr.  Curtis  Blais 
Naval  Postgraduate  School 
589  Dyer  Road  Rm200A,  Monterey,  CA  93943 
(831)  656-2094  -  (831)  656-2488 
iwharnev@nps.navv.mil  -  clblais@nps.navv.mil 


MR.  John  Hiles  and  Dr.  Don  Brutzman 
Naval  Postgraduate  School 
Monterey,  CA  93943, 

(831)656-2988  -  (831)656-2149 
ihiles@mindspring.com  -  brutzman@nps.navv.mil 
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U.S.  Naval  Forces  are  increasingly  the  target  of  terrorist  attack.  There  is  a  strong  need  to  provide  emerging  technologies 
to  forces  afloat  for  analysis  and  visualization  of  tactical  posture  when  defending  warships  in  port.  The  SAVAGE  research 
group  in  the  Modeling,  Virtual  Environments  and  Simulation  (MOVES)  Institute  at  the  Naval  Postgraduate  School  (NPS)  is 
building  a  large  public-domain  library  of  models  and  prototyping  tools.  We  construct  tactically  interesting  virtual 
environments  using  Extensible  3D  (X3D)  graphics,  providing  interactive  displays  either  in  standalone  mode  or  via  the  Web. 
A  sophisticated  series  of  interactive  Web-based  3D  scenarios  utilize  georeferenced  terrain,  humanoid  avatars,  physically 
based  models  and  networked  agent-based  simulation.  For  example,  a  sophisticated  scenario  for  U.S.  Marine  amphibious 
assault  shows  key  spatial  relationships  that  can  easily  be  overlooked  if  solely  analyzing  in  a  2D  context. 

What  Does  it  Really  Cost  the  Navy  When  Wholesale  Supply  Runs  Out  of  Inventory? 

Mr.  Michael  Hiqqins 

Center  For  Naval  Analyses 
4825  Mark  Center  Drive 
Alexandria,  V A  22311-1850 
(703)  824-2408 
higginsm@cna.org 

The  Navy  uses  a  classical  inventory  model  for  determining  when  to  procure  spare  parts  for  their  wholesale  supply.  In 
the  classical  model,  the  average  annual  inventory  cost  is  minimized  by  minimizing  the  sum  of  three  component  costs: 
procurement  cost,  holding  cost,  and  shortage  cost.  Procurement  cost  and  holding  cost  are  relatively  straightforward  to 
calculate  but  shortage  cost  is  more  abstract  -  what  does  it  really  cost  the  Navy  when  the  wholesale  supply  runs  out  of 
inventory  of  a  spare  part?  We  show  how  to  use  the  Navy's  retail  model,  which  they  use  to  determine  sparing  levels  on 
aircraft  carriers,  to  find  "shadow  prices"  for  aircraft  availability.  We  use  these  shadow  prices  to  determine  shortage  cost.  We 
did  a  sample  computation  for  one  spare  part:  a  hydraulic  oil  cooler.  We  determined  that  an  additional  seven  spare  parts  at  the 
wholesale  supply  would  have  cost  an  additional  $10,000  per  year  in  procurement  and  holding  cost  but  would  have  reduced 
the  shortage  cost  by  over  $100,000  per  year. 


Forecasting  Readiness:  A  Regression  Analysis 
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Air  Force  Logistics  Management  Agency 
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marvin.arostegui  @  vakota.af .  mil 


According  to  many  experts,  the  readiness  of  America’s  military  forces  deteriorated  through  the  1990’s,  and  is  still  of 
concern  today.  A  key  measure  of  combat  aircraft  readiness  is  the  mission  capable  rate,  a  measure  used  to  indicate  the 
percentage  of  aircraft  able  to  perform  their  primary  wartime  missions.  The  Air  Force  currently  uses  the  Funding/Availability 
Multi-Method  Allocator  for  Spares  (FAMMAS)  time  series  forecasting  model  to  predict  overall  mission  capable  rates  for 
each  aircraft  type  in  inventory.  While  FAMMAS  does  a  great  job  of  predicting  mission  capable  rates  based  on  funding  data 
and  other  associated  planning  factors,  it  does  not  incorporate  or  explain  the  key  logistics  and  operations  drivers  that  influence 
mission  capable  rates,  which  limits  its  effectiveness  as  a  management  and  decision-making  tool.  Our  research  developed 
explanatory  and  predictive  models  that  provide  more  insightful  forecasts,  by  examining  over  600  variables  from  aircraft 
reliability,  maintainability,  operations,  and  personnel  areas,  and  ten  years  of  quarterly  data.  Our  final  explanatory  model 
contains  six  variables,  reflecting  personnel,  aircraft  inventory,  cannibalization  hours,  and  aircraft  down  time  for  maintenance. 
It  also  includes  an  interaction  factor  that  indirectly  measures  a  unit’s  ability  to  provide  on-site  training.  After  reserving  20 
percent  of  our  data  set  for  validating  the  model,  we  found  the  average  prediction  error  (confidence  interval  halfwidth)  to  be 
1 .9  percent.  In  addition,  two  predictive  models  were  selected  from  50  candidate  models,  based  on  mean  absolute  percentage 
error  and  average  prediction  error  criteria.  One  provides  very  good  point  estimates,  while  the  other  is  a  better  long-range 
predictor. 
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Analyzing  the  Cost  Growth  in  Navy's  Depot  Level  Repair  of  Aircraft 

Mr.  Jim  Jondrow,  Ph  D 

Center  For  Naval  Analyses 
4825  Mark  Center  Drive 
Alexandria,  VA  22311 
(703)  824-2261 
iondrowi  @cna.org 

The  Navy's  cost  per  flight  hour  for  depot  level  repair  (DLR)  of  aircraft  components  rose  sharply  during  the  1990s.  We 
analyzed  this  trend  by  decomposing  into  five  detailed  trends  in:  surcharge  (the  tax  that  pays  for  the  supply  system  and  other 
costs),  the  price  of  a  given  market  basket  of  components,  the  mix  of  components,  the  number  of  repairs  per  flight  hour,  and 
other  costs.  We  found  that  from  FY96  to  FY01,  the  number  of  repairs  per  flight  hour  was  a  dominant  trend.  We  then 
analyzed  the  effect  on  the  trend  of  repairs  per  flight  hour  of  the  aging  of  the  fleet  and  found  that  it  was  the  dominant  factor. 
The  estimated  effect  of  age  provides  a  way  of  adjusting  future  budgets  for  aircraft  aging. 

Development  of  Updated  DoD  Readiness  Reporting  System 

Mr.  Jerry  Macken 

Organization  of  the  Joint  Chiefs  of  Staff 

The  Pentagon  Room  3C876,  Washington,  DC  20319 

(703)  693-5976,  mackenis@is.pentagon.mil 


Abstract  not  available  at  printing. 

Designing  in  Readiness:  ASOAR  Model  to  Improve  RAM  &  Supportability  in  Requirements  & 
Acquisitions  and  Supportability  in  Requirements  and  Acquisitions 

Mr.  Bernard  Price.  C.P.L. 

Army  Communications  &  Electronics  Command  (CECOM) 

AMSEL-PE-SA,  Fort  Monmouth,  NJ  07703 

DSN  992-8752  Comm  (732)  532-8752,  Bernard.Price@maill.monmouth.armv.mil 

The  Communications-Electronics  Command  (CECOM)  has  developed  a  Reliability,  Availability,  Maintainability 
(RAM)  and  Supportability  analysis  model  that  provides  integrated  solutions  for  analyzing  and  developing  Army  and 
Warfighter  RAM  requirements.  The  name  of  this  model  is  the  Achieving  a  System  Operational  Availability  Requirement 
(ASOAR)  model.  This  model  has  the  potential  to  dramatically  improve  the  state-of-the-art  for  implementing  DoD  5000.2-R, 
paragraph  C5.2.3.5.8  covering  RAM  and  help  support  Total  Ownership  Cost  reduction. 

The  ASOAR  model  is  used  to  optimally  allocate  a  system  readiness  requirement  to  Operational  Availability  (Ao)  goals 
for  its  end  items  being  separately  acquired.  Since  the  ASOAR  model  requires  only  system  and  end  item  indenture  level 
inputs,  it  can  be  used  early  in  the  acquisition  cycle  to  determine  the  feasibility  or  costliness  of  an  Ao  requirement. 
Additionally,  ASOAR  has  the  capability  to  analyze  the  Ao  and  Mission  Reliability  for  a  fleet  of  similar  systems  used  for 
accomplishing  a  mission. 

As  an  integrated  RAM  and  Supportability  analysis  model,  ASOAR  will  help  to  determine  Mission  Reliability, 
Maintenance  Ratio  and  Ao  Key  Performance  Parameter  (KPP)  requirements.  Model  usage  will  lead  to  an  improvement  over 
the  present  off-line  Reliability  and  Maintainability  (R&M)  analyses  performed  by  the  Army  Training  &  Doctrine  Command. 
Since  Ao  is  an  integral  part  of  the  R&M  requirements  analysis  performed  by  ASOAR,  the  tool  can  help  the  Army  to  start 
determining  and  utilizing  Ao  KPP  requirements  in  accordance  with  DoD  5000.2-R. 

Integrated  solutions  help  to  lead  to  collaborative  efforts  across  various  communities.  ASOAR  outputs  tied  to  achieving 
a  weapon  system  readiness  requirement  help  to  determine  the  Ao  inputs  to  use  in  supportability  optimization  modeling. 
Supportability  optimization  models  yield  the  least  cost  supply  and  maintenance  concepts  for  an  end  item  to  achieve  its 
inputted  Ao  goal. 

Mathematically,  system  effectiveness  depends  on  the  probability  that  the  system  will  perform  appropriately  in  a  mission, 
the  probability  the  system  will  last  the  duration  of  a  mission  without  failing,  and  the  probability  the  system  is  available  to 
accomplish  a  mission.  The  probability  the  system  will  last  the  mission  duration  without  failing  is  its  Mission  Reliability  and 
the  probability  the  system  is  available  for  accomplishing  a  mission  is  tied  to  its  Ao  prior  to  fielding  and  Readiness  Rate  after 
fielding.  If  ASOAR  Ao  and  Mission  Reliability  outputs  are  used  in  conjunction  with  performance  models  that  determine  the 
probability  that  the  system  will  perform  appropriately  in  a  mission,  system  effectiveness  can  be  better  analyzed. 
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Sustainability  of  Aerospace  Expeditionary  Force  Support  to  Operations  ENDURING  FREEDOM 
and  NOBLE  EAGLE 


Capt  David  Quick 

Air  Force  Air  Combat  Command 

HQ  ACC/DRY 

204  Dodd  Blvd  Ste  226 

Langley  AFB,  VA 

23665-2777 

(757)  764-7262 


Lt  Col  Harry  P.  Conley 

Air  Force  Air  Combat  Command 

ACC/XRS 

204  Dodd  Blvd  Ste  226 
Langley  AFB,  VA 
DSN  574-5718 
Harrv.Conlev@langlev.af.mil 


Capt.  Adam  Wallen 

Air  Force  Air  Combat  Command 

ACC/XRS 

204  Dodd  Blvd  Ste  226 
Langley  AFB,  VA 
DSN  574-5718 


In  December  2001,  Gen  Hal  Hornburg,  Commander  of  Air  Combat  Command  (ACC),  asked  ACC/DRY  for  a  short-term 
analysis  of  proposed  options  for  rotating  forces  to  replace  those  already  deployed  in  support  of  Operations  ENDURING 
FREEDOM  and  NOBLE  EAGLE.  This  paper  will  present  the  results  of  that  analysis  as  well  as  discuss  the  techniques  used 
to  strike  a  balance  between  fidelity  of  the  analysis  and  the  limited  amount  of  time  allowed  to  complete  the  study.  Many 
assumptions  had  to  be  made  about  force  rotation  processes  and  data  to  provide  answers  literally  within  a  matter  of  days. 
Despite  the  lack  of  fidelity,  the  analysis  cast  new  light  on  the  decision-maker’s  problem.  The  study  found  that  the  key  to 
satisfying  critical  CINC  personnel  requirements  was  the  availability  of  trained,  deployable  personnel,  not  force  rotation 
policies.  The  study  recommended  that  the  Air  Force  focus  on  validating  requirements  and/or  increasing  personnel 
availability.  Gen  Hornburg  called  the  work  “low  fidelity,  high  impact  analysis.”  This  study  became  the  catalyst  for  an  Air 
Force-wide  review  of  Air  Expeditionary  Force  policies,  programs,  and  organizations. 


Deployability  Readiness  Metrics 

Mr.  William  A.  Sawyers 

Marine  Corps  Combat  Development  Command 
MCCDC  (C451) 

Quantico,  VA  22134-5130 
(703)  784-6025 
sawyerswa@mccdc.usmc.mil 

The  ability  to  rapidly  task  organize  and  deploy  units  is  a  critical  component  of  Marine  Corps  force  deployment  planning 
and  execution  (FDP&E)  processes.  The  Force  Service  Support  Group  (FSSG)  faces  unique  challenges  because  it  is  not 
organized  in  garrison  as  it  will  deploy  or  fight  in  an  actual  contingency.  By  doctrine,  a  Combat  Service  Support  Element 
(CSSE)  must  be  formed  from  resources  that  reside  in  the  functional  battalions  of  the  FSSG.  The  purpose  of  this  study  is  to 
identify  a  set  of  metrics  that  the  FSSG  can  use  to  assess  their  ability  to  deploy  on  short  notice.  We  examined  existing 
readiness  reports  and  procedures  to  assess  their  utility  to  gauge  deployability  readiness,  and  identify  potential  shortcomings. 
Deployability  readiness  metrics  are  proposed  to  help  commanders  objectively  determine  the  ability  of  units  to  meet 
deployment  requirements  and  highlight  potential  risks.  Using  existing  data,  these  metrics  quantifiably  link  current  readiness 
status  to  the  ability  of  the  FSSG  to  deploy  effective  CSSEs. 


Installation  Privatization  and  Readiness 


Major  Sandy  Vann.  USA 

U.S.  Military  Academy 
3rd  Floor,  Mahan  Hall 
West  Point,  NY  10996 
(845)  938-5897 


The  Honorable  Thomas  A.  White,  Secretary  of  the  Army,  stated  “We  will  find  ways  to  make  more  efficient  use  of  our 
resources  by  bringing  the  best  business  practices  of  Corporate  America  into  our  department.”  Recent  legislative  changes 
(Title  10,  Section  2667)  have  enhanced  the  authority  of  military  departments  to  lease  non-excess  real  property  for  cash  or  in- 
kind  consideration.  Any  revenues  derived  from  the  lease  of  Army  property  under  this  legislation  is  provided  back  to  the 
Army.  As  with  any  underutilized  inventory,  the  goal  should  be  to  look  for  new  ways  to  gain  value  from  the  inventory.  The 
Army  has  an  expanded  tool  for  resourcing  the  upgrade  and  maintenance  of  its  installation  facilities.  This  presentation  will 
propose  a  framework  for  installation  commanders  to  select  which  private  organization  (among  potential  bidders)  to  enter  into 
an  outlease  with. 
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The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 


Evaluating  PC-Based  Simulators  in  Flight  Training 


Captain  R.  Timothy  Barber,  B.S. 
AETC  Studies  and  Analysis  Squadron 
San  Antonio,  Texas  78150 
Phone:  210-652-4917 
FAX:  210-652-6895 
timothy.barber@randolph.af.mil 


Ken  Levi,  Ph.D. 

AETC  Studies  and  Analysis  Squadron 
San  Antonio,  Texas  78150 
Phone:  210-652-4917 
FAX:  210-652-6895 
ken. levi  @randolph. af.mil 


The  presentation  will  review  lessons  learned  in  the  Air  Force’s  MicroFlight  and  the  Navy’s  Micro-Sim  Flying  simulators 
that  are  adaptations  of  the  Microsoft  Flight  Simulator  program.  Specifically,  the  presentation  will  examine  test  and 
evaluation  procedures,  measures  of  effectiveness,  reliability  and  maintainability,  and  cost  benefit  analysis  outlined  in  the 
study  plans  of  the  F-15  Flight  Deck  Systems  and  Procedures  Trainer  and  the  Undergraduate  Navigator  PC  Based  Simulator 
being  inserted  as  proof-of-concepts  into  Air  Force  Air  Education  and  Training  Command  (AETC)  flying  training  curriculum. 
The  presentation  will  conclude  with  a  discussion  of  the  challenges  of  testing,  evaluating,  and  measuring  the  effectiveness 
reliability,  maintainability,  and  cost  of  inserting  technology  into  undergraduate  flying  training  programs. 


Morphing  Games  into  Computer-Based  Learning 


Captain  R.  Timothy  Barber.  B.S. 
AETC  Studies  and  Analysis  Squadron 
San  Antonio,  Texas  78150 
Phone:  210-652-4917 
FAX:  210-652-6895 
timothy.barber@randolph.af.mil 


Ken  Levi,  Ph.D. 

AETC  Studies  and  Analysis  Squadron 
San  Antonio,  Texas  78150 
Phone:  210-652-4917 
FAX:  210-652-6895 
ken.levi@randolph.af.mil 


Briefly,  the  presentation  will  discuss  the  game  technologies  used  and  the  challenges  of  converting  the  respective  game 
technologies  to  computer-based  learning  systems.  Three  of  these  commercially  available  game  technologies  have  been 
inserted  into  Air  Force  Education  and  Training  Command  (AETC)  training  curriculum.  These  include  the  Game  Show 
Assessment  Strategy  to  Reduce  Attrition  (GASTRA),  Air  Force  Microflight  Simulator,  and  “Norma  Brown’’  a  first  person 
perspective  emergency  response  command  and  control  simulator.  The  presentation  will  examine  the  distinctly  different 
measures  of  effectiveness  used  including  student  attrition,  study  hours,  test  scores,  time  to  proficiency,  to  determine  if 
GASTRA  and  Air  Force  Microflight  Simulator  were  successful  converted  to  computer-based  learning  systems.  The 
presentation  will  conclude  with  a  discussion  of  measures  of  effectiveness. 


Instructable  Agents  for  Strategic  Center  of  Gravity  Analysis 


William  H.  Cleckner 

US  Army  War  College 
Center  for  Strategic  Leadership 
650  Wright  Ave 

Carlisle  Barracks,  PA  17013-5049 
Phone:  7 17-  245-4027 
william.cleckner@csl.carlisle.armv.mil 


Gheorghe  Tecuci 
George  Mason  University 
4400  University  Dr. 
Fairfax,  VA  22030-4444 
Phone:  703-993-1722 
tecuci@gmu.edu 


Jerome  J.  Comello 
US  Army  War  College 
Department  of  Military  Strategy,  Planning, 
and  Operations 
122  Forbes  Ave 
Carlisle  Barracks,  PA  17013 
Phone:  717-  245-3498 
ierome.comello@carlisle.armv.mil 


Students  at  the  U.S.  Army  War  College  are  discovering  new  insights  into  Center  of  Gravity  analysis.  They  both  teach 
and  learn  from  an  intelligent  agent  software  program  called  Disciples,  created  in  the  George  Mason  University  Learning 
Agents  Laboratory  (LALAB).  This  paper  will  describe  a  multi-faceted  research  and  development  effort  that  synergistically 
integrates  research  in  Artificial  Intelligence,  Center  of  Gravity  analysis,  and  practical  deployment  of  an  agent  into  Education. 
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Using  Process  Modelling  and  Simulation  to  Optimize  Warrior  Performance:  Developing  the  Most 
Efficient  Military  Organization. 

Neal  Crossland 

Dynamics  Research  Corp 
60  Frontage  Road 
Andover,  MA  01610 
Phone:  978-  475-9090  ext  3020 
FAX:  978-475-8557 
ncrossland@drc.com 

Military  organizations  are  inherently  very  complex,  characterized  by  multiple  interdependencies  operating  in  a 
constantly  changing  environment.  This  complexity  is  exacerbated  when  human  nature  and  group  dynamics  are  factored  into 
the  equation.  Much  of  the  complexity  is  caused  by  six  major  factors  key  to  performance  in  all  organizations:  the  people  or 
workforce,  the  functions  assigned  and  the  processes  used  to  accomplish  those  functions  (the  work),  the  organizational 
structure,  the  physical  facilities,  the  supporting  technology  and  equipment,  and  the  supporting  budget  or  economics. 

While  optimizing  all  six  components  of  the  organization  is  both  ideal  and  ultimately  critical  to  optimal  performance 
improvement,  this  paper  focuses  on  the  most  used/abused  facets  of  mission  performance,  the  workforce  (training),  the  work 
(the  most  ignored  component),  and  their  interdependencies.  Closing  a  performance  gap  in  a  military  organization  requires 
reframing  the  basic  performance  paradigm.  In  order  to  achieve  a  “most  efficient”  end-state  in  a  military  unit,  the  work  and 
workforce  must  be  optimized  and  sustained.  This  can  be  achieved  only  by  carefully  defining  the  ideal  state  of  the  processes 
that  must  be  performed  to  accomplish  the  unit’s  mission  and  the  subordinate  tasks  associated  with  each  of  those  processes. 
This  definition  is  achieved  BEST  by  employing  proven  modeling  techniques  such  as  business  process  analysis  and 
reengineering  methodology  to  optimize  the  work.  Once  high-resolution  models  of  unit  task  performance  requirements  are 
constructed,  simulations  can  be  run  to  find  the  optimal  process  mix  to  achieve  mission  success.  Once  processes  are 
optimized,  the  work  attendant  to  each  process  can  be  further  deconstructed  to  provide  insight  into  task  definition  and 
associated  performance  attributes.  It  is  this  phase  of  optimization  analysis  that  task-based  training  or  other  very  targeted 
performance  improvement  interventions  are  designed  and  developed.  Simulations  employed  in  the  initial  BPR  efforts  are 
then  employed  to  visualize  and  “bench-test”  the  training  and/or  performance  improvement  products  before  fielding  to  ensure 
that  the  interventions  directly  support  unit  performance  goals. 

Once  the  work  and  the  workforce  are  optimized,  that  end-state  must  be  sustained.  Continuous  evaluation  provides  for 
work  process  adjustments  in  light  of  the  constantly  changing  nature  of  unit  mission  tasks  performed.  Concurrently,  task 
performance  by  the  individual  military  member  must  be  supported  in  meaningful  ways  such  as  job  performance  aids 
provided  only  as  the  need  for  that  support  occurs. 

In  very  simple  terms  military  units  must  strive  to  perform  their  work  “better,  faster,  cheaper.”  Quick  results  performance 
fixes  are  not  the  answer.  What  are  required  are  more  intensive  and  comprehensive  analysis  of  soldier,  sailor,  or  airman 
performance  needs  (training  and  job  aids)  and  simultaneous  optimization  of  the  work  itself  (processes  and  workflow).  The 
costs  of  analysis  are  more  than  returned  through  higher  efficiencies  in  the  military  unit  workforce  and  its  work.  In  terms  of 
the  Department  of  Defense  bottom  line,  more  analysis  IS  less  cost  and  better  use  of  tax  dollars  and  the  return  on  investment  is 
measured  in  improved  READINESS. 


Steve  Broussard 
Dynamics  Research  Corp 
Orlando,  FL  32817 
Phone:  407-380-1200  ext  1 1 1 
FAX:  407-380-1205 
sbroussard@drc.com 


Modeling  Maneuver  Warfare  with  SEAS 

Capt  Jeffrey  R.  Del  Vecchio 

2420  Vela  Way,  Suite  1467 

Los  Angles  AFB 

El  Segundo,  CA  90245-5081 

Phone:  310-363-0768,  FAX:  310-363-2519 

ieffrev.delvecchio@losangeles.af.mil 


Lt  Clinton  R  Clark 

2420  Vela  Way,  Suite  1467 

Los  Angles  AFB 

El  Segundo,  C A  90245-5081 

Phone:  310-363-6592,  FAX:  310-363-2519 

clinton.clark@losangeles.af.mil 


The  goal  of  military  education  is  to  help  soldiers  understand  the  nature  of  war  and  to  teach  them  how  to  think 
logically  and  creatively  about  war  and  during  war.  Every  great  military  leader  understood  that  success  in  battle  is 
attributed  to  well-trained  forces.  We  intend  to  show  that  wargaming  can  play  a  major  role  in  the  course  of  instructing 
maneuver  warfare  techniques.  Modeling  and  Simulation  has  a  pivotal  role  to  play  in  providing  trainers  with  sound 
analytical  support  on  training  activities  designed  to  teach  maneuver  warfare.  Our  study  employed  Systems  Effectiveness 
Analysis  Simulation  (SEAS),  an  AF  Toolkit  campaign  level  model.  In  the  past  SEAS  has  been  used  by  senior  AF  decision 
makers  to  determine  future  space  systems  policy.  Future  uses  could  be  to  provide  analytical  support  to  scenario 
construction  and  evaluation  of  the  learning  process,  for  individual  or  collective  training.  Our  research  applies  the 
maneuver  warfare  principles  from  the  Maneuver  Warfare  Handbook  at  the  company  level  and  below.  It  can  be  used  to 
teach  students  to  make  educated  decisions  through  a  coherent,  logical  thought  process.  Advanced  techniques  such  as  unit 
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skills,  conducting  a  specific  type  of  attack,  and  employing  combined  arms  can  be  taught  and  demonstrated.  The  SEAS 
model  was  developed  in  such  a  way  that  it  allows  for  “tactical  programming”,  which  permits  the  application  of  maneuver 
warfare  techniques.  Most  computerized  games  try  to  decide  “who  won”  by  rewarding  “kills”.  SEAS,  however,  is 
designed  to  give  the  decision  maker  or  instructor  or  student  insight  into  the  effects  of  variables.  There  is  no  right  answer 
in  maneuver  warfare,  only  timely  and  logical  ones. 

Employing  Simulation  to  Train  the  Objective  Force:  Laying  the  Foundation  Now 

CPT(P)  Christopher  M.  Farrell  MAJ  Wilburn  C.  Williams 

Operations  Research  Center  of  Excellence  Department  of  Military  Instruction 

Department  of  Mathematical  Sciences  United  States  Military  Academy 

United  States  Military  Academy,  West  Point,  NY  10996  West  Point,  NY  10996 
Phone:  845-938-5661,  FAX:  845-938-5665  Phone:  845-938-2287 

chris.farrell@usma.edu  bill.williams@usma.edu 


As  part  of  the  Army’s  transformation,  the  Objective  Force  Soldier  will  have  state-of-the-art  weapons  and  support 
systems  that  will  increase  his  lethality,  survivability,  and  overall  combat  effectiveness  on  future  battlefields.  Land  Warrior  is 
one  such  system.  Future  training  plans  will  train  and  sustain  soldiers  and  units  on  the  operation,  maintenance,  and 
employment  of  Land  Warrior.  We  view  Computer  Based  Training  (CBT)  that  integrates  Interactive  Multimedia  Instruction 
(IMI)  and  simulation  as  the  ideal  vehicle  to  accomplish  this  task.  This  presentation  introduces  a  vision  for  simulation  in  the 
CBT-IMI  framework  for  Land  Warrior.  This  is  validated  by  assessing  the  effectiveness  of  a  robust  simulation  framework 
currently  being  employed  at  the  United  States  Military  Academy  in  cadet  military  instruction.  Cadets  are  being  trained  in 
both  mounted  and  dismounted  warfare  via  simulations  rooted  in  commercial  off-the-shelf  (COTS)  software.  These 
simulations  are  pseudo-immersive  in  nature,  where  cadets  operate  in  a  computer  based  simulation  environment,  confronted 
with  the  sights  and  sounds  that  attempt  to  replicate  the  fog  of  war.  By  evaluating  simulation  in  collective  training — in  the 
context  of  small  unit  offensive  and  defensive  operations — we  provide  a  basis  for  effective  scenario  development,  software 
reengineering,  and  preliminary  experimental  design  to  evaluate  Land  Warrior  sustainment  training. 


Rapid  Initialization  of  Course  of  Action  (CO A)  Tools  Using  Data  from  GCCS 


Zach  Furness 

The  MITRE  Corporation 
7515  Colshire  Drive 
McLean,  VA,  22102 
703-883-6614,  FAX:  703-883-6435 
zfumess  @  mitre.org 


LCDR  Mike  Fitzpatrick 
SPAWAR 

4301  Pacific  Highway  Bldg  C60 
CODE  PMW-153 
San  Diego,  CA  921 10-0181 
858-537-0181,  FAX:  858-537-0186 
sfitz@spawar.navv.mil 


LTC  Ernie  Isensee 
Combined  Forces  Command,  USFK 
Operations  Analysis  Branch,  C3  Plans 
PSC  303  Box  27 
APO  AP  96204-0027 
011-822-7913-8371 
isenseee  @  usfk .  korea .  army  .mil 

Over  the  past  several  years,  simulations  have  been  increasingly  used  as  a  way  of  developing  and  evaluating  courses  of 
action  (CO As)  during  staff-level  training  exercises.  However,  one  of  the  major  drawbacks  in  using  such  tools  in  the  inability 
to  rapidly  populate  such  simulations  with  data  that  exists  in  C4ISR  systems.  In  the  majority  of  instances,  unit  data  is  read 
directly  off  of  the  available  C4ISR  system  and  input  manually  into  the  COA  simulation.  This  process  can  be  time  consuming 
and  is  prone  to  errors  -  due  to  both  the  manual  nature  of  the  process  and  the  fact  that  the  tactical  picture  may  change 
significantly  by  the  time  all  the  data  has  been  input. 

During  the  Navy's  Global  '01  Wargame  last  year,  an  automated  process  for  initializing  the  Naval  Simulation  System 
(NSS)  based  directly  on  available  track  data  in  the  Global  Command  and  Control  System  (GCCS)  was  used  for  the  first  time 
in  an  exercise.  The  interface  leverages  standard  M&S  and  C4I  architectures  -  employing  components  based  on  the  DII  COE 
and  the  High  Level  Architecture  (HLA).  Use  of  this  capability  led  to  a  significant  improvement  in  the  speed  in  which  NSS 
could  be  initialized,  and  also  the  accuracy  of  the  COAs  evaluated.  Because  it  was  used  directly  by  the  NAVFOR  cell  in  the 
exercise,  it  helped  to  streamline  the  C2  decision  process  for  the  training  audience.  The  success  of  this  application  has  led  the 
Navy  to  employ  it  on  the  USS  Coronado  during  the  upcoming  Fleet  Battle  Experiment  -  Juliet  (FBE-J),  during  the  summer  of 
2002. 


This  year  the  GCCS-NSS  interface  was  extended  to  include  a  second  COA  application  -  the  Integrated  Theater 
Engagement  Model  (ITEM).  The  GCCS-ITEM  initialization  capability  will  be  used  during  exercise  Reception,  Staging,  and 
Onward  Integration  (RSOI)  in  Korea  in  the  Spring  of  2002,  and  again  during  exercise  Ulchi  Focus  Lens  (UFL)  in  Korea  later 
in  2002. 

This  presentation  will  cover  lessons  learned  in  all  of  the  exercise  and  experimental  uses  outlined  above  and  discuss 
future  plans  for  both  applications.  It  will  also  discuss  potential  future  areas  involving  the  interoperability  of  C4ISR  and  M&S 
systems  that  could  significantly  improve  the  C2  decision  process. 
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Operations  Analysis  Supporting  the  Joint  Task 

Cindy  Grier 

HQ  USAREUR  ORSA 
Unit  29351 
Attn:  AEAGS-OR 
APO  AE  09014 

Phone:  49  6221-57-6129,  FAX:  49  6221-57-7024 
Cindv.grier@cmdgrp.hqusareur.army.mil 


HQ  USAREUR  ORSA 
Unit  29351 
Attn:  AEAGS-OR 
APO  AE  09014 

Phone:  49  6221-57-8034,  FAX:  49  6221-57-7024 
bobbi.leyes@cmdgrp.hqusareur.army.mil 


As  the  Army  transforms  to  the  Objective  Force,  the  Legacy  Force  continues  to  maintain  its  overmatch  capabilities. 
Although  the  US  Army  Europe  (USAREUR)  is  a  key  component  of  the  Legacy  Force,  it  also  understands  that  it  must 
maintain  trained  and  ready  forces  capable  of  conducting  military  operations  over  the  entire  spectrum.  As  the  USAREUR 
Headquarters  transitions  into  an  Army  Service  Component  Command  (SCC)  and  increases  involvement  in  Joint  and 
Combined  operations,  the  focus  of  the  Operations  Research  /  Systems  Analysis  (ORSA)  Cell  shifts  from  supporting  Base 
Operations  (BASOPS)  analysis  to  supporting  the  Warfighter.  This  change  in  focus  requires  the  operations  research 
community  to  re-look  analytical  support  provided  to  the  operational  and  tactical  levels  of  command.  The  US  European 
Command  (EUCOM)  took  steps  in  this  revolution  by  providing  Operation  Analysis  (OA)  Teams  to  Joint  Task  Forces  (JTF) 
in  the  European  Theater  starting  in  1997.  This  capability  is  now  official  and  part  of  the  EUCOM  Directive  55-11.  This 
document  ensures  that  each  JTF  has  the  required  analytical  resources  to  plan  for  and  execute  its  mission  successfully. 
Similarly,  the  North  Atlantic  Treaty  Organization  (NATO)  established  an  Exploratory  Team  to  examine  the  Operations 
Analysis  support  to  the  Joint  Task  Force  and  Component  Commanders. 

This  paper  focuses  on  the  capabilities  and  products  that  the  OA  team  brings  to  the  commander.  The  platform  to 
demonstrate  the  utility  of  the  team  is  a  series  of  AGILE  LION  exercises  featuring  a  Southern  European  Task  Force  (SETAF) 
led  JTF  deploying  into  Africa  for  a  SSC  and  our  support  to  an  Air  Force  lead  JTF.  The  authors  will  demonstrate  products 
already  developed  and  their  impact  on  the  success  of  the  mission.  Additionally,  they  will  also  offer  their  experiences  and 
propose  suggestions  about  how  the  OA  team  can  integrate  themselves  as  a  key  part  of  the  JTF  staff. 


Analyzing  Anti-Terrorist  Tactical  Effectiveness  for  Force  Protection  using  X3D  Graphics  and  Agent 
Based  Simulation 
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U.S.  Naval  Forces  are  increasingly  the  target  of  terrorist  attack.  There  is  a  strong  need  to  provide  emerging  technologies 
to  forces  afloat  for  analysis  and  visualization  of  tactical  posture  when  defending  warships  in  port.  The  SAVAGE  research 
group  in  the  Modeling,  Virtual  Environments  and  Simulation  (MOVES)  Institute  at  the  Naval  Postgraduate  School  (NPS)  is 
building  a  large  public-domain  library  of  models  and  prototyping  tools.  We  construct  tactically  interesting  virtual 
environments  using  Extensible  3D  (X3D)  graphics,  providing  interactive  displays  either  in  standalone  mode  or  via  the  Web. 
A  sophisticated  series  of  interactive  Web-based  3D  scenarios  utilize  geo-referenced  terrain,  humanoid  avatars,  physically 
based  models  and  networked  agent-based  simulation.  For  example,  a  sophisticated  scenario  for  U.S.  Marine  amphibious 
assault  shows  key  spatial  relationships  that  can  easily  be  overlooked  if  solely  analyzing  in  a  2D  context.  This  presentation 
shows  technical  results  representing  conflicts  between  friendly  and  hostile  assets,  simulating  complex  ship-level  Anti- 
terrorism  and  Force  Protection  (ATFP)  measures.  Specifically,  we’ve  built  an  agent-capable  3D  reconstruction  of  the  small- 
boat  terrorist  attack  carried  out  by  A1  Qaeda  against  the  USS  COLE  in  October  2000  at  Aden  Harbor  Yemen.  These 
integrated  models  enable  simulation,  experimentation,  visualization  and  statistical  assessment  for  discovering  potential 
shortcomings  in  force  protection.  A  software-agent  architecture  capturing  a  variety  of  friendly  and  hostile  representations  is 
used  to  explore  basic  interactions,  unforeseen  threat  combinations  and  even  sensitivity  analysis  regarding  skills,  training  and 
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personality  traits  of  defending  personnel.  New  applications  of  statistical  analysis  are  possible  using  this  methodology. 
Typically,  outputs  of  interest  include  sequential-statistic  means  and  standard  deviations  for  various  tactical  measures  of 
effectiveness  (MOEs).  For  self-defense  preparations,  however,  outlier  scenarios  that  reveal  unexpected  tactical  vulnerability 
provide  new  and  critically  important  analytic  outputs.  The  ability  to  plan,  replay,  analyze  and  replan  realistic  scenarios 
makes  this  approach  valuable  for  both  training  and  self  defense.  In  closing,  we  examine  next  steps  for  scaling  models, 
simulations  and  statistics  to  battle-group  and  theatre-level  scenarios  of  tactical  interest. 


Analytical  Support  to  Exercises  for  the  Warrior  Preparation  Center 
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The  Warrior  Preparation  Center  (WPC)  is  a  fully  functional  wargaming  center  providing  operational-level  training  and 
exercises  to  US  and  NATO  staffs  worldwide.  The  Analysis  Directorate  of  the  WPC  provides  analytical  support  to  these 
exercises  to  help  the  training  audience  determine  how  well  they  are  meeting  their  training  objectives.  This  is  usually 
conducted  through  the  process  of  an  After  Action  Review  (AAR).  The  purpose  of  this  presentation  is  to  describe  the 
techniques  used  by  the  WPC  analyst  to  help  demonstrate  progress  or  to  determine  whether  or  not  training  objectives  are 
being  met.  Topics  discussed  will  include  techniques  on  how  to  quantify  subjective  evaluations,  trend  line  analysis,  and  the 
development  of  database  tools  to  help  collect  AAR  information.  The  presentation  will  also  discuss  how  the  WPC  analyst 
improves  the  quality  of  an  exercise  by  participating  in  the  planning  process.  It  will  demonstrate  how  some  basic  analysis 
identifies  potential  "holes"  in  an  exercise  scenario  or  identifies  areas  which  require  more  planning  before  the  execution  of  an 
exercise. 


Training  Impact  Analysis  of  the  Global  Combat  Support  System-Army  Phase  I:  Military 
Occupational  Specialty  (MOS)  92 A 
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A  training  analysis  was  conducted  to  identify  ways  to  improve  current  training  for  the  Army’s  Military  Occupational 
Series  (MOS)  92A  (automated  logistics  specialist),  for  which  persistent  training  problems  and  substantial  training 
requirements  have  been  documented,  and  to  reduce  training  problems  for  the  future  Global  Combat  Support  System-Army, 
for  which  the  MOS  92  is  the  primary  operator.  The  analytical  approach  was  to  identify  tasks  critical  to  unit  performance, 
identify  tasks  that  should  have  the  highest  priority  for  advanced  individual  training  (AIT),  and  to  document  training 
requirements  of  soldiers  as  they  transition  to  new  assignments.  A  study  team  conducted  a  three-tiered  structured  training 
priority  assessment  with  unit  supervisors  and  managers  at  56  sites  that  represented  the  several  different  types  of  units  to 
which  MOS  92 A  soldiers  are  assigned.  Soldiers  on  their  second  or  later  duty  assignments  provided  data  on  new  assignment 
training  requirements.  The  study  found  that  all  of  the  tasks  trained  in  AIT,  plus  some  additional  tasks,  are  critical  to  at  least 
some  of  the  units.  Except  for  basic  supply  tasks,  there  was  little  agreement  among  units  regarding  the  tasks  that  should  have 
the  highest  priority  for  AIT.  There  were  few  skill  and  training  requirements  common  across  the  different  types  of  units, 
which  present  a  difficult  training  challenge  for  the  MOS  92A. 

Just  In  Time  Teaching 
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This  presentation  focuses  on  the  feasibility  and  the  effectiveness  of  web-based  Just  In  Time  Teaching  (JITT)  in  Air  Force 
Professional  Military  Education  (PME).  No  two  students  are  at  the  same  cognitive  level;  therefore  some  students  require 
more  attention  than  others.  Currently,  PME  instructors  have  no  way  to  anticipate  student  comprehension  of  the  material. 
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This  determination  is  necessary  to  enable  instructors  to  tailor  informal  lectures,  guided  discussions,  and  case  studies  to 
maximize  in-class  time  and  help  students  achieve  higher  levels  of  cognitive  learning.  JiTT  extends  instructor  contact  time 
via  cyberspace,  allowing  students  to  work  in  two  interactive  instructional  environments:  the  first  being  the  in-class  seminar 
time,  and  the  second  being  a  web-based  setting  that  can  actually  evolve  as  the  class  progresses  and  students’  levels  of 
understanding  are  determined. 


Assessing  the  Impact  of  New  Technology  on  Student  Performance 
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The  Air  Education  and  Training  Command  Studies  and  Analysis  Squadron  Technology  Innovation  Flight  (AETC 
SAS/IT)  conducts  proof  of  concept  studies  on  the  effectiveness  of  innovative  technologies.  The  purpose  of  this  study  is  to 
ask  some  critical  questions  about  the  connection  between  new  technology  for  training  and  education  and  how  it  impacts 
student  performance.  Specifically,  does  new  technology  typically  raise  student  grades;  does  new  technology  typically  raise 
other  measures  of  student  performance;  are  some  technologies  more  successful  than  others;  under  what  conditions  does 
student  performance  go  up  or  down?  Study  design  involves  comparison  between  classes  with  the  new  technology  versus 
classes  without.  This  paper  attempts  to  find  out  why  AETC  SAS/IT  studies  consistently  report  lower  student  grades  after 
new  technology  is  inserted  into  training  curriculum.  The  paper  concludes  with  an  analysis  of  why  this  study  varies  from 
others,  followed  by  detailed  recommendations  for  measuring  the  impact  of  new  technology  on  student  performance  in  the 
future. 


Automated  Administration  for  Education  and  Training 
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The  purpose  of  this  presentation  is  to  bring  together  three  cutting-edge  technologies  into  the  education  and  training 
domain.  This  presentation  will  focus  on  three  distinctly  different  studies  to  measure  the  effectiveness  of  automating 
curriculum  development  and  delivery,  and  it  is  composed  of  three  parts:  Electronic  Classroom,  Thin  Client,  and  Virtual 
Private  Network  (VPN).  Electronic  Classroom  evaluated  the  effectiveness  of  Electronic  Classroom  (EC)  technology  on 
student  comprehension  and  the  potential  for  improved  quality  of  training  and  reduced  training  costs  through  automating  the 
test  administration  process.  Thin  Client  will  evaluate  an  innovative  application  of  Thin  Client  technology  as  an  alternative  to 
conventional  client  desktop  PC/LAN  systems.  VPN  will  study  feasibility  and  effectiveness  Reserve  Officer  Training  Corps 
individuals  accessing  accessing  academic  records  via  .mil  and  .gov  Internet  sites  from  remote  locations.  This  presentation 
will  conclude  with  a  discussion  about  the  cost  analysis  associated  with  studying  the  reliability  and  maintainability  of  these 
technologies. 
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This  presentation  describes  studies  that  measured  the  effectiveness  of  two  portable  training  devices,  Brainchild  and 
Electronic  Books  (E-Books).  The  first  study  tests  the  hypothesis  that  Brainchild’s  portability  and  intuitive  interface 
stimulates  learning  and  decreases  student  washbacks  and  attrition.  Brainchild  is  a  handheld  palm  computer  with  a  simple 
question  and  answer  format  that  enables  students  to  review  course  materials  and  prepare  for  tests.  The  second  study  concerns 
the  suitability  and  effectiveness  of  E-Books  as  a  replacement  for  printed  course  materials.  This  presentation  concludes  with  a 
discussion  of  measurement  results  and  analytic  lessons  learned. 
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Enhancing  DoD  Training  for  Smaller  Scale  Contingencies 
A.  Martin  Lidv 

4850  Mark  Center,  Alexandria,  VA  22311 
703-845-2411,  FAX:  703-845-6977,  mlidv@ida.org 

This  presentation  summarizes  a  recent  Institute  for  Defense  Analyses  self-initiated  Central  Research  Project  that 
examined  the  current  state  of  training  involving  civilian  and  military  participants  engaged  in  preparing  for  future  Smaller 
Scale  Contingency  (SSC)  operations.  Recognizing  the  U.S.  military  forces  deploying  into  SSCs  will  encounter  and  need  to 
coordinate  with  civilian  agencies  of  several  types,  U.S.  joint  and  Service  training  organizations,  including  the  unified 
combatant  commands,  have  sought  opportunities  to  engage  with  them  in  a  training  environment.  For  a  variety  of  reasons 
(non-availability  of  personnel,  costs,  lack  of  effective  planning,  and  others),  attempts  at  such  coordinated  training  have  had 
mixed  results.  The  research  for  this  task  included  as  key  elements  a  series  of  interviews  with  civilian  and  military  contacts 
and  a  questionnaire  sent  to  a  wider  audience,  eliciting  useful  responses  from  both  communities.  The  research  concluded  that 
both  communities — civilian  and  military — recognize  the  value  of  such  prior  training,  but  acknowledge  that  there  are 
impediments  to  its  effective  execution.  The  study  recommends  actions  to  improve  the  military-civilian  training  interface,  and 
suggests  that  additional  research  on  this  topic  could  be  highly  productive. 


Dynamic  Interface  Modeling  and  Simulation  System  (DIMSS):  Just  How  Good  Is  It? 


Capt  Michael  A.  Martinez.  USAF 
JSHIP  JT&E-  Bldg  3191 
22707  Cedar  Point  Road,  Unit  1 
Patuxent  River  NAS,  MD  20653-5379 
Phone:  301-342-4936  Ext  131 
matinezma2@navair.navy.mil 


Michael  F.  Roscoe 

Information  Spectrum  Inc.,  JSHIP  JT&E  -  Bldg  3191 
22707  Cedar  Point  Road,  Unit  1 
Patuxent  River  NAS,  MD  20653-5379 
Phone:  301-342-4936  Ext  226 
roscoemf@navair.navv.mil 


The  “Dynamic  Interface”  issue  between  ship  and  helicopter  is  one  the  Joint  Shipboard  Helicopter  Integration  Process 
(JSHIP)  was  tasked  to  answer.  JSHIP’s  response:  the  Dynamic  Interface  Modeling  and  Simulation  System  (DIMSS).  DIMSS 
integrated  existing  models  to  create  a  high-fidelity  shipboard/helicopter  simulation — specifically,  the  combination  of  a  UH- 
60A  and  a  Navy  Amphibious  Assault  Ship  (LHA).  Limited  by  test  data,  DIMSS  sought  to  validate  the  simulation  for  training 
applications.  An  analysis  of  variance  (ANOVA)  approach  was  used.  An  accreditation  board  convened  to  examine  the  results 
and  evaluate  the  fidelity  and  utility  of  DIMSS.  This  presentation  focuses  on  the  analysis  and  potential  training  scenarios. 

While  expanding  the  operational  envelope  of  helicopters  interfacing  with  Navy  ships  is  necessary  to  provide  the  Joint 
Force  Commander  with  the  greatest  flexibility  in  executing  the  mission,  it  is  equally  important  for  Army  and  Air  Force  units 
to  be  ready  to  go  to  sea  when  the  need  arises.  This  readiness  requires  a  certain  level  of  qualification  and  currency  to  land 
onboard  the  pitching  and  rolling  ship  deck.  Until  recently,  maintaining  currency  required  the  pilot  to  periodically  bounce  a 
ship  deck.  This  was  not  possible  given  the  limited  availability  of  ships  for  deck  landing  qualifications  (DLQs).  With  recent 
changes  in  the  multi-service  memorandum  of  understanding  for  shipboard  landing  requirements,  simulation  can  now  be  used 
to  satisfy  some  of  the  initial  qualification  requirements  (Field  Deck  Landing  Practice)  and  extend  the  currency  of  the  pilot  up 
to  two  years  from  initial  qualification.  The  acceptance  of  simulation  for  DLQ  currency  extension  is  partially  due  to  the 
capabilities  of  shipboard  simulation  demonstrated  by  DIMSS  at  the  NASA  Ames  Vertical  Motion  Simulator.  Since  DIMSS 
replicates  the  workload  experienced  by  the  pilot  in  the  shipboard  environment,  it  is  perfectly  suited  for  providing  pilots  with 
the  experience  of  shipboard  landings  without  actually  going  to  sea.  With  DIMSS,  pilots  are  not  only  learning  the  procedures 
for  landing  on  a  ship,  they  can  become  proficient  in  landing  onboard  a  ship.  DIMSS  models  and  subsystems  will  be 
integrated  into  a  UH-60  SFTS  for  the  101st  Airborne  Division  to  serve  as  a  test-bed  for  enhancing  shipboard  simulation. 


Using  Analytical  Simulations  to  Improve  Performance  of  the  Warfighterys  Simulation 
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The  robustness  of  training  simulations  continues  to  skyrocket  as  the  power  of  computers  drastically  increases  in 
accordance  with  Moore’s  Law.  Without  being  careful  though,  extra  burdens  demanded  by  trainers  in  behavior  and  fidelity 
will  slow  execution  times  to  an  unacceptable  level.  Computer-based  simulations,  such  as  the  WARfighters’  SIMulation 
(WARSIM),  represent  systems  and  forces  built  from  a  complex  and  functional  description  of  military  land  warfare.  The 
computerized  battlespace  that  WARSIM  model  for  training  joint,  corps  and  divisional  commanders  and  their  staffs  can 
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become  unwieldy  in  size  and  functionality.  Functionality  is  key,  but  next  comes  performance  of  the  simulation  as  it  portrays 
combat  and  its  related  behaviors,  environments  and  functions.  One  must  assess  the  performance  of  the  large-scale  simulation 
to  determine  and  justify  the  appropriate  suite  of  fielded  hardware,  software  and  network.  Logistical  support  personnel  and 
training  site  coordinators  need  to  know  whether  newly-built  and  equipped  simulation  centers  will  adequately  handle  the  size 
of  a  specific  training  scenario.  Proactive  efforts  to  analyze  and  predict  the  processes  and  associated  impacts  on  performance 
are  critical.  Using  a  performance  prediction  model,  the  analytical  results  may  help  reduce  time,  resources,  and  risks 
associated  with  the  processes  of  the  training  system  being  acquired.  The  WARSIM  Performance  Emulation  Model  shows 
and  predicts  how  a  training  simulation  will  perform.  The  results  from  the  findings  help  guide  the  development  of  the  actual 
WARSIM  system  components.  This  paper  describes  the  use  of  a  commercial  off-the-shelf  simulation  package  to  emulate 
WARSIM  and  discusses  the  potential  application  to  other  simulation  models  for  applying  analytical  tools  that  predict 
performance. 


Potential  applications  of  JWARS  to  Staff  Training  Support 
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The  JWARS  land,  maritime,  and  air  forces  are  represented  at  a  level  of  detail  that  has  not  been  attempted  before  in 
Theater-level  models.  This  rich  set  of  detail  coupled  with  fast  run  times  provides  an  excellent  vehicle  for  supporting  high- 
level  staff  training  in  joint  operations  in  both  combat  and  non-combat  scenarios.  In  particular,  JWARS  could  potentially 
provide  support  to  staff  training  exercises  in  several  areas  where  significant  challenges  currently  exist.  This  paper  describes 
the  upcoming  release  of  JWARS  and  the  potential  application  of  JWARS  to  several  training  challenges.  Specifically,  it 
addresses  how  to:  Use  the  Joint  Data  Support  (JDS)  Center  for  common  baseline  data.  Build  a  joint  Road  to  War,  Increase 
the  breadth  of  joint  operations  during  single  component  exercises,  Build  automated  plans  and  significantly  reduce 
requirements  for  human  operators,  Conduct  rapid  time  advances  in  simulation  time  between  training  system  scenarios, 
Support  seminar  wargames  of  great  scope  and  length  on  relatively  small  computers.  Modifications  in  JWARS  runtime 
environment  will  be  required  for  some  of  the  applications  described  above,  but  others  could  be  conducted  with  only 
significant  changes  in  the  data  used.  This  presentation  makes  these  distinctions  and  describes  the  effort  required  and  the 
opportunities  available  to  support  training  beyond  the  current  JWARS  analytical  scope. 


Task  Analysis  Through  the  Warrior  Level:  Optimizing  Training  to  Achieve  Mission  Success 

Ronald  Smits  Neal  Crossland 

Dynamics  Research  Corp  Dynamics  Research  Corp 

60  Frontage  Road,  Andover,  MA  01610  60  Frontage  Road,  Andover,  MA  01610 

Phone:  978-  475-9090  ext  1498,  FAX:  978-475-8557  978-  475-9090  ext  3020,  FAX:  978-475-8557 

rsmits@drc.com  ncrossland@drc.com 


At  the  Joint  Unified  Command  level,  the  Joint  Training  System  outlines  a  requirements-based  approach  to  training.  The 
closed-loop,  four-phase  system  outlines  a  structured  methodology  to  define  requirements  and  based  on  observable  training, 
assess  organizational  competence  for  mission  accomplishment,  the  pillar  of  Readiness. 

Using  extensive  Mission  analysis,  strategic  and  operational  objectives  have  been  well  defined  at  the  CINC,  Component, 
and  Service  levels,  but  definition  of  desired  and  expected  outcomes  of  training  is  much  less  clear  at  lower  echelons  of  the 
force  structure.  Moreover,  there  is  no  clear  traceability  of  task  behaviors  at  these  lower  levels  of  military  activity  to  the 
higher  order  requirements.  This  is  especially  true  when  one  examines  task  completion  at  the  individual  or  “shooter”  level  of 
military  operations.  The  readiness  implications  of  this  deficiency  are  great.  A  CINC  or  major  commander  has  no  objective 
way  to  accurately  determine  that  training  activities  provided  personnel  currently  under  his  or  her  command  are  adequate  to 
ensure  efficient  attainment  of  strategic  or  subordinate  task  goals. 

To  rectify  this  analysis  deficiency,  a  task  model  that  decomposes  higher  order  requirements  to  “shooter”  level  tasks  and 
establishes  behaviorally  definable  task  outcomes,  is  required.  Using  the  structured  task  model  in  analysis  enables 
Commanders  to  accurately  determine  the  need  for,  and  desired  outcomes  of,  specific  training  activities  as  related  to 
CINC/Component/Service  objectives  and  as  defined  by  Mission  Essential  Tasks  for  each  level  of  operational  activity. 

This  paper  uses  the  task  decomposition  paradigm  of  Mission-to-Operation-to-Task  to  discuss  how  performance  at  the 
individual  level  enables  or  constrains  the  CINC’s  ability  to  accomplish  the  assigned  missions.  It  establishes  how  task 
definition  that  is  directly  related  to  higher  order  requirements)  provide  traceability,  and  thus  accountability,  for  task 
completion  at  every  level  of  operations.  It  demonstrates  how  training  can  be  rationalized  to  support  the  (changing)  needs  of 
operational  commanders.  Finally,  this  paper  will  outline  the  structured  approach  by  which  “distributed”  mission  and  task 
analysis  contributes  to  more  effective  use  of  scarce  resources  to  achieve  required  readiness  levels. 
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Analytic  Support  to  Training 

Assessing  Decision  Making  Skills  in  Virtual  Urban  Environments 

Sharon  Watts 

ScenPro, Inc. 

101  W.  Renner  Road  Suite  130 

Richardson,  Texas  75082 

Phone:  972-  437-500,  FAX:  972-  437-361 1 

Swatts@ScenPro.com 


Leaders  of  small  dismounted  infantry  units  will  face  growing  responsibilities  and  increasing  challenges  in  combined 
arms  combat  and  in  contingency  operations  in  the  urbanized  battlefield  of  the  future.  Training  for  MOUT  is  limited  by  time, 
cost,  and  safety  factors.  Virtual  environment  technologies  have  the  potential  to  provide  the  Army  with  a  training  and 
assessment  capability  to  meet  these  new  demands. 

In  the  SBIR  Phase  I  Virtual  Soldier  Skills  Assessment  (ViSSA)  Project,  ScenPro,  Inc.  performed  research  for  the 
development  of  an  automated  training  assessment  and  after-action  review  support  tool  to  assist  trainers  with  mission 
rehearsal  of  dismounted  forces  for  Special  Operations  and  Contingency  Operations  using  virtual  urban  environments.  The 
ViSSA  system  is  currently  in  Phase  II  development,  tracking  mission-related  factors  linked  to  soldier  decisions,  movements, 
fires,  contact  with  virtual  entities,  and  time  factors  under  an  intricate  web  of  overlays  designed  to  capture,  analyze,  and  store 
these  specific  pieces  of  data  during  a  virtual  training  exercise.  The  result  is  a  training  and  assessment  system  that  can 
accurately  monitor  soldier  performance  and  quickly  summarize  leadership  strengths  and  weaknesses  across  key  performance 
dimensions. 

The  information  assists  the  trainer  in  conducting  an  effective  after-action  review  by  providing  the  rapid  replay  of  events, 
summary  statistics,  Socratic  questions,  and  top-down  snap  shot  views  of  the  simulation  at  critical  decision  points  during  the 
virtual  training  exercise  to  support  leadership  performance  evaluations. 
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The  following  abstracts  are  listed  in  alphabetical  order  by  principal  author. 
Common  User  Database  Development 


Raymond  B.  Devore,  Jr. 

Operations  Research  Analyst 

AMEDDC&S,  CHES 

1608  Stanley  Road 

Fort  Sam  Houston,  TX  78234 

(210)  221-9405 

Fax:  (210)  295-0229 

rav.devore@cen.amedd.army.mil 


LTC  Pat  M.  McMurry 

Chief,  Force  Structure  and  Analysis  Branch 

AMEDDC&S,  ACFI 

1400  East  Grayson  Street,  Suite  305 

Fort  Sam  Houston,  TX  78234 

(210)  221-0938 

Fax (210) 471-2947 

pat.mcmurry@cen.  amedd .  army .  mi  1 


David  A.  Bengert 

Computer  Specialist 

AMEDDC&S,  CHES 

1608  Stanley  Road 

Fort  Sam  Houston,  TX  78234 

(210)  221-2097 

Fax  (210)  295-0229 

david.bengert@cen.amedd.armv.mil 


One  key  to  good  models  is  good  data  input  into  the  model.  We  are  working  on  developing  a  database  that  will  provided 
data  for  input  into  models  for  patient  care  and  movement  within  the  theater.  The  Common  User  Database  starts  with  a 
Patient  Condition  and  breaks  it  down  into  one  or  more  medical  conditions.  Each  of  these  medical  conditions  will  be 
associated  with  the  tasks  to  be  performed.  The  next  step  is  to  assign  a  set  of  tasks  to  each  medical  condition.  Each  task  will 
be  associated  with  the  equipment  and  supplies,  in  generic  terms)  required  to  perform  the  task. 

Personnel  at  the  Army  Medical  Department  Center  and  School  (AMEDDC&S)  are  developing  a  prototype  database 
structure  based  on  input  from  tri-service  representatives  and  personnel  from  the  Joint  Readiness  Clinical  Advisory  Board 
(JRCAB).  It  has  not  been  determined  who  will  develop  the  final  database. 


Stress  Casualty  Forecasting 


Charles  W.  Elliott 

Army  Medical  Department  Center  and  School 

1400  East  Grayson  Street,  Suite  305 

Fort  Sam  Houston,  TX  78216 

(210)  221-2985  (fax  (210)  471-2947) 

charles.elliott@cen.amedd.armv.mil 

COL  Gregory  Belenky,  MC,  USA 
Walter  Reed  Army  Institute  of  Research 
Silver  Spring,  MD 
(301)  319-9085 
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LTC(ret)  Andrea  Bradford,  MC,  USA 
Magellan  Behavioral  Health  Regional  Service  Center 
2550  North  Winds  Parkway,  Suite  300 
Alpharetta,  GA  30004 
(678)  319-3755 


COL  James  W.  Stokes,  MC,  USA 
Army  Medical  Command 
2050  Worth  Road,  Suite  10 
Fort  Sam  Houston,  TX  78234-6010 
(210)  221-8235 


Impact  of  Small  Work  Teams  on  Combat  Care  &  Emergency  Care  Performance 


Vinette  Langford  RN,  MSN 

Director  of  Operations  and  Training 
MedTeams  Systems  Group 
Dynamics  Research  Corporation 
60  Frontage  Rd.,  Andover,  M A  01810 
vlangford@drc.com 


John  Charette,  MD 
LTC,  Medical  Corps,  US  Army 
Chief,  Emergency  Medicine  Dept 
Madigan  Army  Medical  Center 
Ft.  Lewis,  WA 

John.charette@nw.amedd.armv.mil 


Daniel  Risser,  Ph.D. 

Chief  Scientist 
MedTeams  Systems  Group 
Dynamics  Research  Corporation 
60  Frontage  Rd.,  Andover,  M A  01810 
drisser@drc.com 


The  MedTeams  Program  is  a  DoD  research  initiative  that  establishes  small  clinical  work  teams  composed  of  physicians, 
nurses,  and  technicians  and  evaluates  the  power  of  this  reengineering  to  reduce  clinical  errors  and  improve  the  efficiency  of 
emergency  and  combat  care  delivery  in  both  field  hospitals  and  fixed  facilities.  The  teamwork  principles  are  drawn  from 
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research  on  military  and  civilian  aircrews.  The  project  has  evaluated  the  positive  impacts  of  employing  these  teams  and 
teaching  teamwork  skills  to  clinicians.  The  training  has  also  proven  valuable  in  improving  the  job  performance  of  non¬ 
medical  support  personnel  in  field  medical  units.  Simulation  facilities  that  employ  the  use  of  patient  simulators  are  being  set 
up  so  that  high-risk  clinical  care  conditions  can  be  simulated  and  difficult  teamwork  can  be  exercised  without  risks  to 
patients.  Future  proposed  efforts  include  1)  capturing  team  performance  data  from  the  simulator  environment  training 
exercises  to  support  organization-level  modeling  efforts  and  2)  modification  of  team  training  curriculum  to  support  rapid, 
large-scale  train  up  of  teamwork  skills  in  homeland  defense  groups  that  must  respond  to  terrorist  events. 

Exploring  the  Validation  of  Lanchester  Equations  for  the  Battle  of  Kursk 

Dr.  Tom  Lucas,  Capt  John  Dinges,  USA  and  Lieutenant  Turker  Turkes,  Turkish  Army 

Naval  Postgraduate  School 

Monterey,  CA  93943 

(831)  656-3039 

twlucas@nps.navv.mil 

This  research  explores  the  validation  of  Lanchester  equations  as  models  of  the  attrition  process  for  the  Battle  of  Kursk  in 
World  War  II.  The  methodology  and  results  of  this  study  extend  previous  validation  efforts  undertaken  since  the 
development  of  the  Ardennes  Campaign  Simulation  Data  Base  (ACSDB)  in  1989  and  the  Kursk  Data  Base  (KDB)  in  1996. 
The  KDB  is  a  computerized  database  developed  by  the  Dupuy  Institute  and  the  Center  for  Army  Analysis  from  military 
archives  in  Germany  and  Russia.  The  data  are  two-sided,  time-phased  (daily),  highly  detailed,  and  encompass  15  days  of  the 
campaign.  This  work  examines  how  the  various  derivatives  of  Lanchester’ s  equations  fit  the  newly  compiled  database  on  the 
Battle  of  Kursk.  In  addition,  the  effect  of  using  purely  engaged  forces,  in  contact  forces,  and  all  forces  in  parameter 
estimation  is  examined. 


Predicting  Battle  Outcomes  With  Classification  Trees 

Dr.  Tom  Lucas,  Dr.  Sam  Buttrey  and  Lieutenant  Muzaffer  Coban,  Turkish  Army 

Naval  Postgraduate  School 

Monterey,  CA  93943 

(831)656-3039 

twlucas@nps.navv.mil 

What  factors  are  associated  with  victory  in  combat?  To  look  at  this  question,  this  talk  applies  classification  and 
regression  trees  (CART)  to  the  CDB90G  land  combat  data  set.  This  data  was  developed  the  Center  for  Army  Analysis 
(CAA)  and  contains  about  140  attributes  on  nearly  660  land  battles.  The  classification  trees  reveal  that  objective  variables, 
by  themselves,  cannot  explain  the  outcome  of  battles.  Relative  factors,  such  as  leadership,  have  deep  impacts  on  success. 
The  classification  model  predictions  on  test  sets  reveal  correct  classification  rates  as  high  as  79  percent.  Considering  the 
variability  in  the  data  set,  this  outcome  is  satisfying.  Classification  models  also  reveal  that  the  factors  affecting  the  outcome 
of  battles  have  changed  over  time.  A  leadership  advantage  played  an  important  role  for  hundreds  of  years.  However,  in  the 
20th  century,  air  sorties,  tanks,  and  intelligence  showed  a  higher  importance. 

Reducing  Non-monotonicities  in  Combat  Models 

Dr.  Tom  Lucas  and  Maj  Bill  Vinyard,  USMC 

Naval  Postgraduate  School 

Monterey,  CA  93943 

(831)  656-3039 

twlucas@nps.navv.mil 

Non-monotonic  behavior  in  combat  models  is  an  important  topic  to  those  using  the  output  of  such  models  as  a  basis  for 
decision-making.  These  decisions  can  be  complicated  by  non-monotonic  behavior  in  the  combat  models.  This  research 
examines  the  Dewar  model,  which  exhibits  non-monotonic  behavior  caused  by  the  chaos  inherent  in  its  structure.  The  dozen 
or  so  previous  papers  on  this  model  have  examined  only  small  subsets  of  this  18  dimensional  combat  model.  The 
combinatorial  possibilities  of  main  effects  and  interactions  among  the  18  dimensions  are  too  great  to  examine  en  masse. 
Consequently,  we  use  some  advanced  statistics  to  explore  the  model  with  three  primary  goals.  First,  systematically  explore 
the  Dewar  model  for  additional  non-monotonic  behavior.  Second,  determine  the  effect  of  stochastic  modeling  on  the  non¬ 
monotonic  behavior  of  the  Dewar  model  response  surface.  Third,  develop  a  method  for  measuring  non-monotonicity  in  the 
response  surface  generated  by  the  model. 
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Casualty  Estimation  for  Medical  Planning  for  an  NBC  Environment 

Dr.  Gene  McClellan  Sharon  M.  Watts 

Veridian  Systems  Division,  Inc.  ScenPro,  Inc. 

1400  Key  Blvd.  Suite  700  101  W.  Renner  Road  Suite  130 
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LTC  Debra  D.  Schnelle,  MSC 

Office  of  The  Surgeon  General 

ATTN:  DASG-HCF 

5111  Leesburg  Pike,  Suite  401 A 

Falls  Church,  VA  22041-3258 

Phone:  (703)  681-8185  FAX:  (703)  681-4971 

Debra.Schnelle@otsg.amedd.armv.mil 


The  U.S.  Army  Office  of  the  Surgeon  General  (OTSG)  is  the  NATO  Custodian  for  Allied  Medical  Publication  8, 
Medical  Planning  Guide  for  the  Estimation  of  NBC  Battle  Casualties.  Over  several  years,  OTSG,  with  the  advice  and 
assistance  of  NATO  medical  experts,  developed  three  volumes,  one  each  for  nuclear,  biological,  and  chemical  weapons.  All 
three  volumes  were  ratified  by  the  NATO  NBC  Medical  Working  Group  in  February,  2001.  Beginning  in  1999,  OTSG 
directed  the  development  of  the  medical  Nuclear,  Biological,  and  Chemical  (NBC)  Casualty  and  Resource  Estimation 
Support  Tool  (CREST)  as  a  deliberate  medical  planning  capability  for  an  NBC  environment.  The  NBC  CREST  software 
application  estimates  NBC  casualties  based  on  the  methodology  of  Allied  Medical  Publication  8.  In  addition,  NBC  CREST 
provides  map-based  scenario  generation,  medical  resource  estimation  based  on  treatment  protocols  from  the  Joint  Readiness 
Clinical  Advisory  Board,  and  coarse-of-action  analysis  based  on  Tables  of  Organization  and  Equipment  for  generic 
battlefield  medical  treatment  facilities  (MTFs)  of  the  U.S.  Army.  The  casualty  estimation  methodology  relies  in  part  on  the 
estimation  of  individual  performance  degradation  caused  by  exposure  to  NBC  agents. 


Behavioral  Impacts  on  Battlefield  Performance  in  JWARS 


John  Prince 

JWARS  (CACI) 

1555  Wilson  Blvd.  (Suite  620) 
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dvakas@caci.com 


Chuck  Burdick 
JWARS  (Lockheed  Martin) 
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Arlington,  VA  22209 
chuck.burdick@lmco.com 


Jerry  Halbert 
NGIC 

220  7th  Street  NE 
Charlottesville,  VA  22902 
gahalbe@mail.ngic.ic.gov 


George  Kuhn 
LMI 

200  Corporate  Ridge 
McLean,  VA  222102 
gkuhn@lmi.org 


LTC  Harry  Argo,  USA 
JWARS 

1555  Wilson  Blvd.  (Suite  620) 
Arlington,  VA  22209 
harrv.argo@osd.pentagon.mil 


Kay  Burnett 
NGIC 

220  7th  Street  NE 
Charlottesville,  VA  22902 
kburnett@ngic.osis.gov 


In  the  JWARS  theater-level  analytical  model,  units  from  countries  with  limited  training,  less  combat  experience,  or  poor 
leadership  can  be  made  to  perform  at  lower  levels  of  effectiveness  than  units  from  countries  that  have  significantly  better 
training,  extensive  combat  experience,  and  good  leadership.  Within  a  particular  country’s  forces,  additional  distinctions  can 
be  made  among  elite,  standard,  and  substandard  units  and  between  functionally  different  units  (combat,  combat  support,  and 
combat  service  support).  Less  capable  units  also  suffer  greater  attrition  and  rout  or  surrender  earlier  (depending  on  several 
other  factors).  To  support  this  representation,  the  National  Ground  Intelligence  Center  (NGIC)  has  rated  foreign  ground 
forces  according  to  a  set  of  characteristics  related  to  combat  performance.  JWARS  has  applied  this  concept  of  “soft  factors” 
to  JWARS  land  forces.  Currently,  soft  factors  directly  affect  six  unit  performance  characteristics:  breakpoints,  rate  of  direct 
fire,  degree  and  length  of  unit  suppression,  speed  of  maneuver,  and  time  to  don  MOPP  gear.  This  presentation  is  the  next  in  a 
series  of  reports  on  the  development  of  soft  factors  in  JWARS,  and  it  provides  information  on  installations  and  facilities  with 
respect  to  defining  the  work  they  do  (unit  performance  characteristics)  and  a  unit’s  effectiveness  with  and  without  soft  factors 
considered.  It  also  discusses  the  direction  JWARS  is  going  with  respect  to  the  interaction  of  soft  factors  with  other  “soft” 
elements  represented  in  JWARS  such  as  unit  effectiveness  due  to  significant  numbers  of  wounded,  contaminated,  or 
otherwise  incapacitated  personnel. 
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BioTerrorism  Planning:  San  Antonio  Lessons  for  Success 
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Real-Time  Predictive  Medical  Data  Fusion  Watchboard 
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Assessing  Decision-making  Skills  in  Virtual  Urban  Environments 

Sharon  M.  Watts 

ScenPro, Inc. 

101  W.  Renner  Road  Suite  130 
Richardson,  Texas  75082 
(972)  437-5001  FAX:  (972)  437-361 1 
SWatts@ScenPro.com 

Members  of  small  dismounted  infantry  units  will  face  growing  responsibilities  and  increasing  challenges  in  combined 
arms  combat  and  in  contingency  operations  in  the  urbanized  battlefield  of  the  future.  Training  for  MOUT  is  limited  by  time, 
cost,  and  safety  factors.  Virtual  environment  technologies  have  the  potential  to  provide  the  Army  with  a  training  and 
assessment  capability  to  meet  these  new  demands. 

In  the  SBIR  Phase  I  Virtual  Soldier  Skills  Assessment  (ViSSA)  Project,  ScenPro,  Inc.  performed  research  for  the 
development  of  an  automated  training  assessment  and  after-action  review  support  tool  to  assist  trainers  with  mission 
rehearsal  of  dismounted  forces  for  Special  Operations  and  Contingency  Operations  using  virtual  urban  environments.  The 
ViSSA  system  is  currently  in  Phase  II  development,  tracking  mission-related  factors  linked  to  soldier  decisions,  movements, 
fires,  contact  with  virtual  entities,  and  time  factors  under  an  intricate  web  of  overlays  designed  to  capture,  analyze,  and  store 
these  specific  pieces  of  data  during  a  virtual  training  exercise.  The  result  is  a  training  and  assessment  system  that  can  predict 
battlefield  performance  and  quickly  summarize  soldier  strengths  and  weaknesses  across  key  performance  dimensions. 

The  information  assists  the  trainer  in  conducting  an  effective  after-action  review  by  providing  the  rapid  replay  of  events, 
summary  statistics,  Socratic  questions,  and  top-down  snap  shot  views  of  the  simulation  at  critical  decision  points  during  the 
virtual  training  exercise  to  support  performance  evaluations. 


165 


Battlefield  Performance, 
Casualty  Sustainment  &  Medical  Planning 


WG-23 


NBC  Medical  Resource  Estimation  and  Course  of  Action  Analysis 


Sharon  M.  Watts 

ScenPro,  Inc. 

101  W.  Renner  Road  Suite  130,  Richardson,  Texas  75082 
(972)  437-5001  FAX:  (972)  437-3611 
SWatts@ScenPro.com 


Michael  T.  Gately 
ScenPro,  Inc. 

101  W.  Renner  Road  Suite  130,  Richardson,  Texas  75082 
(972)  437-5001  FAX:  (972)  437-3611 
MGatelv@ScenPro.com 


Dr.  Gene  McClellan 
Veridian  Systems  Division,  Inc. 

1400  Key  Blvd.  #700,  Arlington,  VA  22209 
Phone:  (703)  516-6204  FAX:  (703)  524-2420 
Gene.McClellan@Veridian.com 


LTC  Debra  D.  Schnelle,  MSC 

Office  of  The  Surgeon  General 

ATTN:  DASG-HCF,  5111  Leesburg  Pike,  Suite  401 A 

Falls  Church,  VA  22041-3258 

Phone:  (703)  681-8185  FAX:  (703)  681-4971 

Debra.Schnelle@otsg.amedd.armv.mil 


The  Nuclear,  Biological,  and  Chemical  Casualty  Resource  Estimation  Support  Tool  (NBC  CREST)  supports  deliberate 
medical  planning  in  an  iterative,  integrated  process  for  US  Army  medical  planning  at  the  Corps,  Division,  and  Corps  Medical 
Brigade  levels.  The  Resource  Requirements  Estimator  (RRE)  module  of  NBC  CREST  provides  a  quick  logistical  estimate  of 
medical  requirements  in  the  NBC  environment  based  on  the  potential  for  casualties.  RRE  estimates  include  weight,  volume, 
and  time-phase  resource  requirements  over  the  duration  of  treatment.  The  Course  of  Action  Analysis  (COAA)  module 
provides  a  time-phased  estimate  of  the  critical  medical  resources  required  for  patient  treatment  compared  to  the  capability  of 
deployed  medical  resources  to  meet  the  demand.  Graphical  displays  provide  a  high  level  assessment  of  critical  NBC  medical 
resource  sufficiency  based  on  the  Class  VIII  Materiel,  Personnel,  Evacuation  Assets,  and  Beds  available  at  each  level  of  care 
in  the  user-defined  medical  support  network.  Depending  on  the  required  level  of  resource  satisfaction  and  detail  required,  the 
user  may  drill-drown  and  iteratively  modify  existing  deployed  medical  resources  down  to  the  unit  level  to  resolve  potential 
resource  shortfalls,  or  evaluate  the  benefits  of  additional  medical  support  during  the  planning  stages  of  a  mission.  Subsequent 
analyses  will  show  how  well  the  new  medical  Course  Of  Action  resource  set  satisfies  the  requirements.  The  NBC  CREST  is 
currently  being  developed  in  conjunction  with  the  Army  Office  of  the  Surgeon  General  (OTSG). 
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Addressing  the  Cost  and  Value  of  C4I  Information  in  AOAs 

Mr.  Joseph  Auletta 
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The  nature  of  major  Air  Force  system  acquisitions  is  substantially  changing.  The  systems  themselves  are  much  more 
information  dependent,  and  many  Analyses  of  Alternatives  (AoAs)  for  these  acquisition  systems  must  address  a  trade  of 
money  spent  on  information  vs.  money  spent  on  warhead.  This  presentation  will  focus  upon  several  significant  steps  the  Air 
Force  has  taken  to  improve  how  it  analyses  the  value  of  information  in  AoAs,  some  still  needed  improvements,  and  some 
problem  areas  as  we  continue  to  adapt  the  AoA  process  for  C4I  systems.  The  specific  areas  of  discussion  include  how  to  cost 
C4I  support  to  weapon  system  and  how  to  measure  the  value  of  C4I  in  pre-warfare  environment. 

JWARS:  The  Assessment  Process  (V&Vy  T&E) 

CDR  Boots  Barnes.  USN,  Mr.Mike  Metz,  IMC,  MAJ  Joe  Mansir,  ATEC,  Ms.  Sharon  Nichols  AFOTEC 

OSD  PA&E,  JWARS  Office 

1555  Wilson  Blvd,  Suite  620,  Rosslyn,  VA  22209 

(703)-696-9490  FAX  (703)-696-9563 

barness@osd.pentagon.mil 

The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  constructive  simulation  that  shall  provide  a  multi-sided 
and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  CINCs,  Joint  Task  Force  (JTF) 
Commanders/Staff,  Services,  Joint  Staff,  Office  of  the  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS 
will  be  capable  of  performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  IOC,  and  will  be  able  to  perform  System 
Effectiveness  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  FOC. 

This  presentation  will  provide  insight  into  the  assessment  process  of  JWARS.  The  assessment  process  includes  both 
Verification  &  Validation  (V&V)  and  Test  and  Evaluation  (T&E)  which  are  outlined  in  the  JWARS  V&V  Plan  and  JWARS 
Test  and  Evaluation  Plan  (TEP).  The  V&V  Plan,  as  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD 
VV&A  Recommended  Practices  Guide  (RPG),  modified,  where  appropriate,  for  the  JWARS  V&V  effort.  The  T&E  Plan,  as 
also  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD  5000.1  and  5000.2  acquisition  documents  for 
ACAT  III  level  programs  and  Automated  Information  Systems  (AISs),  modified,  where  appropriate,  for  the  JWARS  T&E 
effort.  The  Joint  Analytic  Model  Improvement  Program  (JAMIP)  is  the  proponent  of  the  JWARS  model.  The  associated 
JAMIP  Executive  Committee  (EXCOM)  and  Steering  Committee  (SC)  are  the  associated  approval  authorities  for  the  V&V 
process  and  T&E  process.  This  presentation  will  discuss  the  importance  of  the  assessment  process,  user  interface, 
verification  and  validation  activities,  test  and  evaluation  activities,  documentation  procedures  and  reporting  criteria.  The 
V&V  as  well  as  the  T&E  processes  encompass  the  internal  JWARS  office  efforts  as  well  as  the  V&V  agent  and  Operational 
Test  Agencies  interface  with  the  user  and  test  community. 
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For  a  number  of  years,  we  have  been  developing  an  analytical  structure  suitable  for  weapons  analysis.  Originally,  it  was 
focused  narrowly  on  single-platform,  ballistic  live-fire  analysis.  More  recently,  we  have  generalized  the  structure  for  systems 
of  systems.  Test  and  Evaluation  (and  the  activities  and  processes  that  support  it)  is  just  one  of  many  focus  areas  that  are 
amenable  to  the  data  structures,  operators,  order  of  instantiation,  and  process  sharing  that  this  framework  exhibits. 

From  an  overarching  perspective,  one  can  argue  that  the  Army’s  acquisition  business  derives  from  a  panoply  of  military 
missions  underwritten  by  materiel.  If  that  is  true,  one  can  divide  the  problem  into  two  indirectly  connected  pieces.  Part  One 
is  to  define  the  mission  in  terms  of  its  (generally  abstract)  objectives  and  then,  through  a  mission-to-strategy-to-task 
(decompositional)  process,  develop  and  define  the  sequence  of  tasks  (order,  context  [e.g.,  site,  time,  weather],  and  standards 
[e.g.,  how  quickly,  how  error-free])  which  if  so  performed  will  accomplish  the  mission  objectives.  Part  Two  of  the  problem 
is  to  defme/assign  the  appropriate  materiel  requisite  to  the  execution  of  the  defined  tasks. 

To  refine  the  argument,  a  data  structure  exists  within  Part  One  consisting  mostly  of  mission  Measures-of-Effectiveness 
(MOEs).  The  MOEs  may  originate  at  the  National  Command  Level  (or  lower)  and  can  be  decomposed  to  the  required  level 
of  detail.  At  each  of  the  sub-levels  within  this  major  category,  each  MOE  either  points  to  a  subordinate  MOE  or  terminates 
in  a  supporting  task(s).  It  is  these  task  termination  nodes  that  specify  what  materiel  needs  to  accomplish. 

Part  Two  of  the  structure  involves  the  actual  materiel;  this  category  is  populated  by  the  component  pieces  that  constitute 
the  various  platforms.  However,  at  this  point  the  two  structures  are  not  linked  and,  in  fact,  are  not  compatible.  Part  One 
defines  what  tasks  need  be  accomplished.  Part  Two  defines  what  material  is  available.  To  form  a  link,  the  component  pieces 
must  be  integrated  into  a  system  of  systems  and  mapped  to  aggregate  capabilities,  metrics  that  are  compatible  with  task 
requirements. 

The  final  element  is  recognizing  that  the  individual  component  pieces  of  Part  Two  don't  necessarily  perform  in  an 
unchanging  fashion.  Through  the  processes  of  mission  execution,  parts  will  be  used  up,  worn  out,  and  broken,  as  well  as 
receive  ballistic  and  other  classes  of  damage  from  the  OPFOR  that  further  degrade  the  state  of  components.  Provision  must 
be  made  to  admit  state  changes  to  components  (as  defined  by  the  mission  profile). 

In  summary,  this  structure  defines  a  series  of  connected  metrics  starting  with  highest-level  mission  MoEs  and  then 
leading  to  tasks.  The  tasks  are  then  related  to  aggregate  materiel  capabilities,  next  to  the  supporting  component  pieces,  and 
finally  to  the  robustness  of  those  pieces  susceptible  to  state  changes,  both  “negative”  (e.g.,  ballistic  damage)  and  “positive” 
(e.g.,  fuel  resupply).  In  this  structure,  the  highest-level  MoEs  are  the  primary  metrics.  All  of  the  subsequent  metrics  are 
derivative,  including  capability-based  performance.  Generally  the  lower-level,  derivative  metrics  are  measurable  while  many 
of  the  higher-level  metrics  are  not. 

This  structure  makes  possible  the  assignment  of  benefits,  both  primary  and  derivative.  It  also  can  account  for  costs,  both 
those  traceable  to  the  direct  purchase  of  material  as  well  as  to  the  execution  of  activities  defined  by  mission-based  tasks  (in 
the  spirit  of  activity-based  costing). 

In  this  paper,  we  describe  this  structure,  review  the  primary  and  derivative  metrics,  and  discuss  which  metrics  are 
observable  or  only  knowable  via  inference.  We  will  discuss  how  this  structure  contributes  to  the  prosecution  of  the  T&E 
process,  the  universe  of  measurable  and  nonmeasurable  metrics,  how  the  classes  of  metrics  are  linked,  and  how  value  as  well 
as  costs  can  be  ascribed  within  this  context  in  order  to  support  cost/benefit  analyses. 
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This  study  supports  Objective  Force  Combat  Battalion  concept  development  and  the  Army  Transformation.  It  focused 
on  developing,  examining,  and  refining  Combat  Battalion  concepts,  and  supporting  the  Future  Combat  System  (FCS) 
Mission  Needs  Analysis. 

The  study  scenario  facilitates  analysis  of  the  Objective  Force  in  combat  operations.  The  scenario  provides  a  context  in 
which  an  Objective  Force  Combat  Battalion  conducts  offensive  operations  in  2015  against  a  technologically  advanced  Red 
force.  The  engagement  was  explicitly  modeled  using  the  Interactive  Distributed  Engineering  Evaluation  and  Analysis 
Simulation  (IDEE  AS)  model.  IDEE  AS  is  an  entity-based  simulation,  capable  of  force-on-force  representations,  that  permits 
examination  of  concepts  and  parametric  analysis  at  the  engineering  level  of  detail.  Use  of  the  notional  battalion  force 
structure  allowed  O&O  concept  exploration  prior  to  force  design  decisions. 

This  study  contributed  substantially  to  the  development  of  the  Objective  Force,  especially  with  regard  to  the  Unit  of 
Action  force  design.  In  addition  to  the  development  of  concepts,  tactics,  and  insights  for  future  operations  the  study  provided 
a  powerful  visualization  of  this  future  force.  The  scenario  and  base  case  developed  during  this  study  were  used  extensively 
by  the  TRADOC  Unit  of  Action  Task  Force  in  their  subsequent  refinement  of  the  force  design.  These  tools  were  also  used 
by  the  Army  Medical  Department  in  its  transformation  wargame  effort. 

This  presentation  will  provide  an  overview  of  the  study  scenario’s  purpose,  methodology  and  results. 
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This  paper  makes  the  bold  claim  that  an  explicit  theory  for  “measures  of  effectiveness”  (MOEs  as  they  are  commonly 
referred  to)  does  not  exist.  As  a  result  several  definitions  for  MOEs  have  been  advanced,  that  while  similar,  do  not  provide 
the  needed  insight  in  to  system  performance  evaluation.  The  earliest  references  to  MOEs  are  found  in  Chapter  3  of  “Methods 
of  Operations  Research”  (Philip  M.  Morse  and  George  E.  Kimball,  Peninsula  Publishing,  1970,  1st  edition,  revised).  Their 
description  of  MOEs  is  somewhat  general  but  their  concept  of  “constants”  that  define  system  performance  is  consistent  with 
many  approaches  that  followed. 

Original  studies  performed  by  the  Military  Operations  Research  Society’s  (MORS)  Command  and  Control  workshop  in 
the  mid-  1980s  laid  a  foundation  for  a  more  theoretical  approach  that  was  well  received  within  the  MORS  community. 
However,  little  has  been  done  in  the  last  decade  to  further  this  work.  Most  papers  in  the  latter  part  of  the  1990s  make  no 
reference  to  the  workshop  reports  and  other  published  papers  that  resulted  from  the  workshop. 

The  emphasis  on  systems-of-systems  thinking  and  Network  Centric  Warfare  concepts  makes  a  coherent  theory  of  MOEs 
a  necessity.  The  inability  to  clearly  articulate  C2  MOEs  has  contributed  to  the  current  interoperability  problems  faced  by  the 
Navy. 

This  paper  will  present  a  review  of  the  original  work  performed  by  MORS  as  well  as  relevant  material  that  has  been 
published  in  the  intervening  years. 

It  will  extend  the  original  body  of  work  using  the  systems-of-systems  perspective  originally  developed  by  Russell 
Ackoff.  A  concise  systems  based  definition  of  MOEs  will  be  derived  using  this  framework.  The  paper  will  also  present  the 
framework  for  a  consistent  mathematical  theory  for  MOEs. 

This  paper  will  present  a  paradigm  for  MOEs  that  is  grounded  in  systems  theory.  The  result  will  be  a  consistent 
approach  that  provides  a  basis  for  developing  testable  MOEs  within  a  mathematical  framework  that  allows  for  evaluating  the 
statistical  significance  of  change  when  performing  analysis  of  alternatives. 
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Situational  awareness  is  a  commonly  used  but  ill-defined  idea  that  is  applied  to  the  execution  of  tactics  and  strategy.  The 
traditional  method  of  evaluating  situational  awareness  is  by  attrition.  While  it  is  not  easy  to  describe  the  conditions  necessary 
for  good  situational  awareness,  it  is  possible  to  identify  some  conditions  of  poor  situational  awareness. 

While  useful  in  focused  applications,  traditional  approaches  have  lacked  both  formality  and  comprehensiveness.  It  is 
easy  to  provide  a  measure  of  situational  awareness  when  there  are  absolute  right  and  wrong  actions,  but  difficult  when  the 
term  is  applied  at  the  tactical  or  strategic  level.  Degree  of  success,  interpretation  of  condition,  and  utilization  of  resources,  are 
some  factors  that  are  considered  in  the  informal  estimation  of  situational  awareness.  Even  these  factors  are  relative,  not 
absolute  in  nature.  The  game  of  Klondike  solitaire  has  an  absolute  measurement  of  success,  namely  the  number  of  cards 
moved  from  the  tableau  to  the  foundations.  For  a  given  shuffling  of  the  cards  it  may  not  be  possible  to  move  all  cards  to  the 
tableau;  the  situational  awareness  of  the  solitaire  player  should  be  gauged  against  the  maximum  achievable  score  for  the 
situation,  not  the  maximum  theoretical  score.  To  add  even  more  complexity  to  a  relatively  simple  example,  Klondike 
solitaire  is  an  imperfect  knowledge  game.  The  player’s  decisions  are  based  on  knowledge  that  represents  a  subset  of  the  total 
state  of  the  game.  Thus  the  player’s  situational  awareness  is  not  only  a  function  of  what  is  know  and  what  can  be  know,  but 
also  of  the  player’s  understanding  of  what  can  and  cannot  be  known.  An  evaluation  of  situational  awareness  must  be  based 
upon  an  understanding  of  the  relationship  between  the  reality  of  the  situation  and  the  perception  of  the  situation. 

This  paper  provides  a  general  framework  for  formally  defining  Situational  Awareness  and  its  component  metrics  and 
instantiating  them  for  real  world  situations.  Methods  are  presented  for  applying  the  general  definitions  to  specific  situations 
and  producing  a  usable  data  collection  and  analysis  plan  for  the  evaluation  of  Situational  Awareness  for  many  problems. 
Consistency  across  many  domains  of  application  is  one  of  the  key  features  of  this  approach.  It  is  heartening  to  see  that 
traditional  approaches  can  be  expressed  as  special  cases  of  this  general  theory,  and  new  approaches  can  be  used  with  legacy 
systems. 
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Elliptical  estimations  of  position  are  significantly  more  complex  to  evaluate  than  circular  or  point  estimates.  The 
geometry  of  the  ellipse  makes  more  conventional  measures  of  the  quality  and  inappropriate.  Conventional  measures  may 
produce  misleading  data  that  can  vary  significantly  depending  on  the  order  in  which  the  test  data  are  analyzed.  To  avoid 
these  pitfalls,  the  measures  of  effectiveness  for  elliptical  estimations  of  position  should  be  based  on  elliptical  geometry. 

While  the  theory  for  evaluating  ellipses  is  more  complex,  the  measures  of  effectiveness  themselves  are  relatively  simple 
and  yield  unambiguous  and  robust  results.  In  the  vast  majority  of  cases,  the  quality  of  containment  of  a  contact  for  an  ellipse 
can  be  measured  by  the  K  value: 

K  =  1  -  r/d 

Usefulness  may  be  evaluated  as  the  measure  of  the  effort  required  to  locate  a  contact  within  the  ellipse,  the  minimum  search 
area,  the  Quality-Area  product: 

QA=  ilA 
d2 

Both  of  these  measures  can  be  calculated  from  only  the  known  characteristics  of  the  ellipse  and  the  corresponding  true 
position  of  the  contact. 

Other,  more  complex  evaluations  of  the  elliptical  estimation  of  position  are  offered  in  this  paper  for  cases  when  the 
technical  requirements  of  the  test  are  commensurately  more  complex.  These  other  measures  of  effectiveness  grow  in 
complexity  with  requirements  of  the  problem.  They  provide  a  more  advanced  perspective  on  quality  and  usefulness,  and 
serve  to  illustrate  the  context  of  the  workhorse  measures,  the  K  value  and  the  Quality-Area  product.  As  technology  advances 
and  automated  systems  are  capable  of  solving  problems  considered  too  difficult  or  too  time  consuming  for  traditional 
evaluation,  and  as  integrated,  multi-platform  systems  create  solutions  of  greater  complexity,  the  need  for  these  advanced 
measures  of  effectiveness  will  increase. 
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Joint  Global  Positioning  System  Combat  Effectiveness  (JGPSCE)  Joint  Test  and  Evaluation  (JT&E) 

Captain  Michael  Kram 

JGPSCE  JTF 
2050A  2nd  Street  SE 
Kirtland  AFB,  NM  87117 
505-853-1719,  FAX  505-853-1974 
michael  .kram  @  afotec .  af .  mil 


On  29  July  1999,  the  Office  of  the  Secretary  of  Defense  (OSD),  Deputy  Director,  Developmental  Test  and  Evaluation 
(DD,DT&E),  Strategic  and  Tactical  Systems  (S&TS),  in  cooperation  with  the  Joint  Chiefs  of  Staff  and  the  Services, 
chartered  the  JGPSCE  Joint  Test.  Over  a  four-year  period,  the  JGPSCE  JT  is  conducting  a  series  of  test  events  that  focus  on 
joint  operations  where  the  Global  Positioning  System  (GPS)  is  denied  or  degraded  by  hostile  electronic  warfare  (EW)  or 
friendly  electromagnetic  interference  (EMI).  Specifically,  the  JGPSCE  JT  is  addressing  the  following  issues: 

Issue  1:  What  is  the  impact  of  GPS  vulnerabilities  on  the  effectiveness  of  joint  operational  missions  that  require  precision 
engagement? 

Issue  2:  What  changes  in  joint  tactics,  techniques,  and  procedures  (TTPs)  or 
system-level  mitigation  techniques  improve  or  maintain  joint  operational  mission  effectiveness  in  the  event  of  GPS  EW  and 
EMI? 

Issue  3:  What  test  methodologies  can  be  employed  to  characterize  GPS  vulnerabilities  in  future  acquisition  and 
integration  programs? 

The  JGPSCE  JT  conducted  its  second  field-test  -  GYPSY  BRAVO  Part  1  -  from  9  through  25  Jan  02  at  Naval  Air 
Station  Fallon  Range  Training  Center.  The  focus  of  the  second  test  was  to  assess  the  impact  of  EW  and  EMI  on  a  selected 
set  of  weapon  systems  including  precision  guided  munitions.  This  presentation  will  highlight  the  JGPSCE  test  concept, 
methodology,  and  preliminary  results. 

TRACER/FSCS  Combined  Analysis 

Wiiliam  J.  Krondak 

TRAC,  245  Sedgwick  Ave 
Fort  Leavenworth  KS  66027 
(913)684-9188/9191 
krondak  w  @  trac .  army  .mil 

During  the  last  two  years,  a  combined  UK/US  operational  analysis  working  group  conducted  the  Tactical 
Reconnaissance  Armoured  Combat  Equipment  Requirement  (TRACER)/Future  Scout  Cavalry  System  (FSCS)  analysis 
leading  up  to  the  February  2001  Affordability  Review  held  in  London.  This  presentation  will  show  the  study  approach, 
highlight  the  initiatives  in  new  Measures  of  Performance  (MOP)  and  Measures  of  Effectiveness  (MOE)  used  by  the  two 
countries,  note  the  challenges  and  successes  of  a  combined  analysis  and  present  the  analysis  results.  Included  in  the 
presentation  will  be: 

A  brief  review  of  the  methods  and  tools  used  in  the  analysis,  including  the  MOE  and  MOP,  the  models,  and 
scenarios. 

The  technical  analysis  and  system  performance  approach  and  results. 

The  operational  effectiveness  analysis  results,  highlighting  the  effects  of  innovative  approaches  to  representing 
ground  scout  capabilities  in  combat  models,  and  the  insights  gained  from  the  work. 

The  combined  cost  analysis  approach  and  results. 

General  conclusions  and  recommendations. 

Lessons  learned  regarding  MOE  and  MOP  that  may  apply  to  Future  Combat  System  and  Objective  Force  analysis. 

The  Use  Of  Design  Of  Experiment  During  Tactics  Development 

Bran  McAllister  Cindy  Zessin 

Sverdrup  Technology,  Inc.  Sverdrup  Technology,  Inc. 

Eglin  AFB,  FL  Eglin  AFB,  FL 

The  emergence  of  a  new  level  of  international  terrorism,  especially  as  a  direct  and  significant  threat  to  the  security  of  the 
continental  US,  is  a  perfect  illustration  of  a  factor  that  will  demand  changes  in  military  tactics,  doctrine,  and  weaponry.  We 
should  expect  to  see,  therefore,  changes  in  strategy,  operational  doctrine,  tactics,  and  weapons  over  the  near  future.  We  may 
also  see  an  increase  in  the  funding  for  these  endeavors.  However,  we  can  be  sure  that  in  any  case,  resources  for  testing  will 
always  be  constrained.  There  will  always  be  a  need  for  efficient  as  well  as  effective  testing. 
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The  purpose  of  this  study  was  to  demonstrate  the  utility  of  DOE  in  the  tactics  development  arena  in  order  to  dispel  the 
myths  that  DOE  is  either  impractical  or  ineffective.  The  study  included  both  experimental  design  (for  example,  the  use  of 
factorial  experiments,  randomization,  independent  trials)  and  analysis  (the  use  of  ANOVA).  The  study  utilized  a  Microsoft 
Excel-based  simulation  of  aerial  combat — a  relatively  simple,  but  nevertheless  high  fidelity  model  of  aerial  combat 
engagements  involving  as  many  as  8  versus  8  players,  using  notional  but  realistic  event  probabilities  obtained  from  subject 
matter  experts.  The  model  includes  such  events  as  threat  detection,  hostile  declaration,  and  effective  missile  employment. 
After  a  significant  amount  of  verification  using  subject  matter  expertise,  the  model  was  given  favorable  reviews.  We  then  set 
up  a  notional  tactics  development  evaluation,  with  a  number  of  control  factors  typical  of  TD&Es  (threat  electronic  warfare, 
friendly  support  assets,  threat  tactics  options,  and  friendly  rules  of  engagement)  to  assess  two  notional  friendly  tactics 
(Option  A  and  Option  B).  Our  response  variables  included  such  typical  air-to-air  success  measures  as  kill  ratios,  threats 
killed,  and  friendlies  lost. 

The  result  of  this  study  is  a  method  of  demonstrating  the  utility  of  DOE  during  the  most  complex  of  tests,  as  the  Air 
Force  embarks  on  a  program  to  make  it  the  methodology  of  choice  for  all  Air  Force  testing. 

The  Attrition  Model 


Mr.  Andrew  McCabe 

9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 
Admccab  @aol  .com 


Mr.  Tyler  Faloon 
9800  Savage  Road,  Suite  6675 
Fort  Meade,  MD  20755-6675 
443-479-5520,  301-688-9169 


The  presenters  designed,  developed  and  now  exercise  an  Attrition  Model  on  behalf  of  senior  management  at  the  National 
Security  Agency.  The  model  is  Markovian  based,  that  was  developed  in  the  spring  of  1996  to  better  understand  and  then 
forecast  how  the  early-out  and  incentives  offered  to  Agency  civilian  employees  would  affect  attrition  figures  and  help  the 
Agency  achieve  its  downsizing  goals.  The  model  has  been  in  use  consistently  since  1996,  with  the  presenters  making 
significant  enhancements,  updates  to  accurately  reflect  changes  in  the  Agency,  and  calibration  of  underlying  transition  figures 
over  this  time  period.  The  model’s  accuracy  has  been  fairly  good  when  early-out  and  incentive  programs  offered  to  Agency 
civilians  have  remained  constant. 

The  Attrition  Model  incorporates  the  Agency  full-time  civilian  population  to  the  entity  level  and  uses  historical  attrition 
rates  to  project  how  many  individuals  will  leave  Agency  service  in  a  given  time  period.  The  model  calculates  regular  and 
early  retirement  based  on  the  attributes  of  age  and  years-of-service  as  these  are  the  primary  factors  involved  in  an  individual’s 
retirement  decision.  Resignation,  on  the  other  hand,  is  tied  more  closely  to  an  individual’s  skill  field;  therefore  the  model 
makes  resignation  projections  based  on  occupational  codes  and  age.  The  model  is  best  used  as  a  predictor  of  overall  Agency 
attrition  expectations,  but  has  been  use  at  lower  level  of  analysis  for  organizations  and  groups. 

The  Attrition  Model  and  its  results  will  be  presented. 

Quantifying  Utility  based  on  GPS  Performance  Attribute  Values 

Kirk  Mever 

Veridian  Engineering,  Inc. 

5200  Springfield  St,  Ste.  200 
Dayton,  OH  45431 
937-476-2510;  937-476-2900  -  Fax 
kirk.mever  @  veridian.com 

The  GPS  Performance  Attribute  Analysis  Tool  (GPAAT)  was  developed  to  compute  and  analyze  the  military  utility  of 
various  GPS  performance  attributes,  such  as  availability,  accuracy,  integrity,  and  received  signal  power.  This  framework  has 
been  built  to  assist  in  the  determination  of  GPSIII  design  specifications  by  calculating  and  analyzing  the  linkages  between 
specific  system  Performance  Attributes  and  operational  Measures  of  Merit.  GPAAT’s  construct  is  modeled  around  the 
complete  “strategy-to-task”  decomposition  of  Joint  Vision  2020.  GPS  performance  attribute  values  are  used  to  calculate 
Measures  of  Performance  (MOP),  such  as  navigation  error  and  CEP  for  use  cases  within  the  JV2020  decomposition. 
GPAAT  provides  traceability  from  MOPs  to  Measures  of  Utility  (MOU),  including  Measures  of  Effectiveness  (MOE)  and 
Measures  of  Outcome  (MOO).  This  tool  determines  performance-cost  trades  for  military  operations  by  analyzing  the  cause- 
effect  relationship  between  performance  attributes  and  cost.  This  analysis  approach  will  enable  military  decision  makers  to 
quantify  the  benefits  associated  with  improving  specific  performance  attribute  values.  The  presentation  includes  an  outline 
of  the  tool  structure  and  flow,  a  sample  scenario  of  military  use  cases,  and  utility  analysis. 
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Measures  of  Effectiveness  Applied  to  Joint  Combat  Identification 

Mr  Joel  R.  Parker 

JCIET  Command,  JFCOM 
Eglin  AFB,  FL  32542 
(850)  882-6700,  Ext.  #7524 
ioel.parker@eglin.af.mil 

Emerging  requirements  within  DoD  now  challenge  the  newly  designated  Joint  Combat  Identification  and  Evaluation 
Team  (JCIET)  Command  as  it  looks  to  plan  future  evaluations.  These  emerging  requirements  are  (1)  The  conduct  of  CID 
evaluations  within  established  joint  exercises;  and,  (2)  Evaluations  of  the  Key  Performance  Parameters  (KPPs)  stated  in  the 
newly  approved  Combat  Identification  (CID)  Capstone  Requirements  Document  (CRD). 

The  JCIET  Command  serves  as  a  joint  activity  under  the  command  &  control  of  the  Joint  Forces  Command  (JFCOM)  to 
evaluate  the  joint  mission  area  of  Combat  Identification  (CID).  The  objective  of  Command  participation  in  the  2002  Military 
Operations  Research  Society  Symposium  (MORSS)  is  to  interact,  through  an  information  presentation,  with  the  MORS 
community.  This  proposed  interaction  would  focus  on  emerging  requirements  driving  Measure  of  Effectiveness  (MOE) 
refinements/developments  for  the  Command.  The  scope  of  the  presentation  would  be  limited  to  the  practical  use  of  MOEs  for 
root-cause  analysis  in  evaluating  the  formal  joint  Mission  Area  of  Combat  Identification. 

Root-cause  analysis  does  not  employ  statistical  techniques.  The  Command  is  largely  limited  to  this  method  of  analysis 
because  of  the  employed  method  for  collecting  data.  All  data  is  collected  during  an  evaluation  conducted  over  a  two-week 
period  within  a  live,  dynamic  joint  environment  allowing  the  prosecution  of  free  play  operations.  Collected  data  allows 
detailed  mission  reconstruction  and  supports  rigorous  analysis  of  evaluation  objectives. 

JCIET  Operations  are  joint  in  nature  and  comprise  joint  task  force  resources.  Such  operations  employ  select  land,  sea  and 
air  weapons  platforms,  staffs  and  forces  across  all  of  the  Services.  These  resources  are  “networked”  with  Command  and 
Control  (C2)  and  Intelligence,  Surveillance  and  Reconnaissance  (ISR)  systems.  ISR  systems  include  all  levels  of  conflict,  i.e. 
National  Technical  Means  (NTM),  operational  and  tactical.  “Networking”  consists  of  existing  or  developmental  tactical  data 
networks. 

The  JCIET  Command  welcomes  the  opportunity  to  provide  an  information  presentation  to  interested  members  of  the 
MORSS  community  regarding  refinements  and  use  of  established  MOEs  to  assist  root-cause  analysis  associated  with  these 
two  emerging  requirements. 

Evolution  of  Statistical  Electromagnetic  (EM)  Testy  Analysis ,  and  Assessment  Techniques 

Michael  Purello 

(540)  653-8900 
purelloma@nswc.navy.mil 

Quantifying  the  performance  of  systems  during  and  after  the  occurrence  of  a  high  frequency  EM  event  is  difficult  using 
conventional  test,  analysis  and  assessment  techniques.  Conventional  EM  test,  analysis,  and  assessment  techniques  are 
deterministic  and  are  ill  suited  for  applications  to  problems  containing  large  unmanageable  uncertainties.  It  may  be  possible 
to  determine  the  probability  of  survival  or  probability  of  failure  of  a  system  based  on  the  results  of  testing  conducted  at  levels 
below  the  threat. 

Virtually  all  Navy  systems  are  contained  within  some  type  of  enclosure.  The  ability  to  predict  the  probability  of  upset  to 
electronic  equipment  due  to  high  levels  of  electromagnetic  energy  outside  the  enclosure,  without  having  to  conduct  threat 
level  testing  is  most  desirable.  This  is  especially  true  since  some  of  the  threats  are  still  on  the  drawing  board.  The 
introduction  of  new  systems  and  COTS  items  into  the  operational  environment  without  adequate  EM  testing  can  (and  has) 
resulted  in  serious  problems.  The  ability  to  predict  the  potential  for  problems  based  on  low-level  type  tests  conducted  on 
commercially  available  equipment  should  prove  valuable  in  screening  out  potential  problem  equipments. 

Statistical  EM  test,  analysis,  and  assessment  techniques  have  been  successfully  used  to  extract  useful  information  from 
the  measured  fields  in  large  enclosures  such  as  reverberation  chambers.  Statistical  models  of  the  field  quantities  are  a 
convenient  and  simple  way  of  describing  the  uncertainty  inherent  in  high  frequency  EM  interactions.  The  knowledge  of  this 
uncertainty  permits  the  design  and  implementation  of  practical  test,  analysis,  and  assessment  techniques. 

Course  of  Action  Comparison  in  Coalition  Humanitarian  Assistance  and  Disaster  Relief  Missions 

CPT  Frank  J.  Snyder  CDR  Robert  L.  Wohlschlegel,  USN 

Department  of  Systems  Engineering,  MADN-SE  United  States  Pacific  Command,  J-38 

United  States  Military  Academy  92-1123  Makamai  LP 

West  Point,  NY  10996  Kapolei,  HI  96707 

(845)  938-3573,  FAX  5665,  frank-snvder@usma.edu  (808)  477-8267,  mpatsec@aol.com 
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Comparing  courses  of  action  or  alternatives  in  order  to  make  any  decision  is  a  non-trivial  endeavor.  However,  when 
choosing  among  courses  of  action  in  coalition  humanitarian  assistance  and  disaster  relief  (HA/DR)  missions,  the  process  is 
extremely  complex.  Differences  in  doctrine,  language,  agenda,  policy,  level  of  contribution,  ability,  and  other  areas 
complicate  the  decision  process  so  severely  that  it  is  necessary  to  delineate  clearly  a  process  that  is  understandable  by  all  and 
that  serves  to  unify,  not  divide,  the  coalition.  This  presentation  shares  the  author's  experience  in  facilitating  the  course  of 
action  comparison  portion  of  a  multi-national  planning  augmentation  team  (MPAT)  crisis  action  planning  exercise  during  a 
United  States  Pacific  Command  (USPACOM)  training  event  in  Seoul,  Korea  from  1 1-18  January  2002.  Key  to  the  course  of 
action  comparison  process  are  determining  what  measures  of  effectiveness  are  appropriate,  how  the  measures  of  effectiveness 
should  be  defined,  how  measures  of  effectiveness  should  be  weighted,  how  the  alternatives  should  be  scored,  and  what  the 
results  mean.  Finally,  the  strengths  and  weaknesses  of  this  MPAT  course  of  action  experience  are  provided  along  with 
recommendations  for  improving  the  process. 

Development  of  Countermeasure  Performance  Parameters  to  Address  Terrorist  Threats 
Robb  Wilcox,  Ph  D.,  P.E. 

Johns  Hopkins  University  Applied  Physics  Laboratory 

National  Security  Technology  Department 

Systems  Engineer,  Information  Technologies  Group  (STI) 

443-778-7705,  robb. wilcox @  ihuapl.edu 

Abstract  unavailable  at  printing. 

Weapon  Effects  Analysis  and  Probability  Software  (WE APS) 

Greg  Wilder 

AAC/ENMS 

Engineer,  Air-to-Surface  Analysis  Branch 
Modeling  &  Simulation  Division 
850.882.3723  x3517  DSN  872,  FAX:  882.9049 
greg.wilder@eglin.af.mil 

WEAPS  is  an  easy-to-use  software  package  that  calculates  the  effectiveness  for  many  combinations  of 
weapon/target/delivery  aircraft/delivery  profile/weather-state  using  Joint  Munitions  Effectiveness  Manuals  -  Air-to-Surface 
(JMEM/AS)  tri-service  approved  methods.  For  the  targets,  such  as  hardened  bunkers,  for  which  the  JMEM/AS  methods 
aren’t  appropriate,  engineering  level  models  are  used  to  perform  off-line  calculations  and  the  results  directly  loaded  into  the 
WEAPS  database  for  inclusion  into  the  calculated  output.  Aircraft  attrition  can  also  be  output,  but  requires  an  externally 
generated  database. 

The  WEAPS  database  covers  inventory  and  non-inventory  weapons  and  is  under  continual  update  and  revision.  The 
source  for  most  inventory  weapon  data  is  the  JMEM/AS  Weaponeering  System  (JAWS).  There  are  many  sources  for  non¬ 
inventory  weapon  data,  but  they  include  the  Air  Force  Research  Laboratory  Munitions  Directorate. 

The  output  data  is  most  often  used  as  an  input  for  theater-level  models  such  as  the  Combat  Forces  Assessment  Model 
(CFAM),  but  can  also  be  used  as  the  basis  for  engagement-level  (one-versus-one)  analysis.  The  WEAPS  predecessor, 
SABSEL,  has  been  used  for  many  studies,  including  Analysis  of  Alternatives,  Quadrennial  Defense  Reviews  and  is  a  key 
tool  in  the  annual  Non-nuclear  Consumables  Annual  Analysis  (NCAA)  process  where  the  Air  Force  establishes  weapon 
inventory  requirements.  Where  SABSEL  was  only  available  to  a  select  few  organizations,  WEAPS  will  be  available  to  all 
DoD  agencies  and  their  contractors. 

WEAPS  is  PC  based  and  is  being  developed  with  Microsoft  Visual  C++.  The  WEAPS  code  is  unclassified,  but  will  use 
a  classified  database.  The  initial  release  of  WEAPS  is  anticipated  early  summer  2002,  with  annual  updates  thereafter.  A 
subscription  is  required  to  receive  WEAPS,  which  will  include  an  annual  WEAPS  User's  Group  meeting  and  training  session. 
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Test  and  Evaluation  plays  an  important  role  toward  ensuring  that  war  fighters  have  equipment  that  is  operationally 
suitable  and  effective  for  intended  use.  Verified  and  validated  modeling  and  simulation  (M&S)  is  a  recognized  part  of  the 
Simulation,  Test  and  Evaluation  Process  (STEP).  Benefits  of  M&S  in  T&E  -  in  terms  of  risk  reduction,  reduction  in  assets 
required  for  test,  knowledge  gained,  and  design  of  experiments  -  are  appreciated,  but  can  be  difficult  to  quantify  and  monitor. 
In  a  climate  of  limited  developmental  resources,  program  managers  may  be  reluctant  to  let  budgetary  decisions  rely  even  in 
part  on  M&S  predictions  of  system  performance.  This  can  be  especially  true  if  negative  publicity  arises  on  shortcomings  that 
M&S  was  intended  to  detect  for  redesign  prior  to  fabrication.  The  authors  seek  to  identify  a  deliberate  management  method 
that  affects  the  use  of  M&S  in  T&E.  The  authors  will  review  selected  programs  that  have  used  M&S.  The  authors  will 
review  the  type  of  information  needed  to  reach  each  acquisition  milestone,  identify  how  M&S  was  used  throughout  the 
program,  critique  and  draw  conclusions.  Based  upon  these  conclusions,  the  authors  will  offer  a  preliminary  methodology  and 
metrics  for  when  to  use  M&S  in  T&E. 


Analytic  Test  and  Evaluation  Management  System  (ATEMS) 

Eugene  Abravanel  James  Wallace,  ETAS 

DOT&E  /  Center  for  Countermeasures  Suite  202,  Crystal  Square  5 
1407  MLK,  JR.  Drived  1755  Jefferson  Davis  Highway 

WSMR,  NM  88002  Arlington,  VA  22202 

505-678-7242  (*5519)  wallacei  @mail. etas. com 

gene. abravanel  @ccm.  osd.mil  703-414-0191 


Michael  Wetzl,  ETAS 
Suite  202,  Crystal  Square  5 
1755  Jefferson  Davis  Highway 
Arlington,  VA  22202 
wetzlm@mail.etas.com 

703-413-3163 


Major  stresses  are  being  placed  on  the  Test  and  Evaluation  (T&E)  community.  Advances  in  weapons  technology  require 
advanced  and  more  complex  T&E.  Testing  must  also  be  more  efficient  to  complete  the  same  high  quality  evaluations  with 
less  manpower,  a  shorter  schedule  and  reduced  funding.  Several  programs  are  building  advanced  tools  and  developing  new 
test  processes  to  meet  the  increasing  demands  on  the  T&E  community.  They  will  provide  software  infrastructures,  simulation 
environments,  command  and  control  visualizations,  interoperable  ranges,  and  more.  Many  of  these  tools  are  being  developed 
with  a  focus  on  supporting  actual  or  simulated  test  events  or  future  weapons  systems.  TESTSIM,  a  T&E  management 
system,  targets  support  to  the  tester  and  the  evaluator.  It  will  provide  knowledge-based,  automated  decision  support  for  the 
entire  DoD  T&E  process.  Key  capabilities  will  include  automated  support  to  Analysis  of  Alternatives,  decisions  on 
"readiness  for  OT",  and  analysis  of  interactions  between  the  System  Under  Test  (SUT)  and  its  virtual  or  actual  test 
environment.  This  paper  will  review  the  TESTSIM  concept,  how  it  supports  the  DoD  acquisition  model  and  T&E  process, 
and  the  TESTSIM  development  strategy. 
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JWARS:  The  Assessment  Process  (V&V,  T&E) 

CDR  Boots  Barnes,  USN,  Mr.Mike  Metz,  IMC,  MAJ  Joe  Mansir,  ATEC,  Ms.  Sharon  Nichols  AFOTEC 

OSD  PA&E,  JWARS  Office 

1555  Wilson  Blvd,  Suite  620 

Rosslyn,  VA  22209 

(703)-696-9490  FAX  (703)-696-9563 

bamess@osd.pentagon.mil 

The  Joint  Warfare  System  (JWARS)  will  be  a  state-of-the-art,  constructive  simulation  that  shall  provide  a  multi¬ 
sided  and  balanced  representation  of  joint  theater  warfare.  Users  of  JWARS  will  include  the  CINCs,  Joint  Task  Force  (JTF) 
Commanders/Staff,  Services,  Joint  Staff,  Office  of  the  Secretary  of  Defense  (OSD),  and  other  DoD  organizations.  JWARS 
will  be  capable  of  performing  Courses  of  Action  and  Force  Sufficiency  analyses  at  IOC,  and  will  be  able  to  perform  System 
Effectiveness  and  Trade-off  analysis  and  Concept  and  Doctrine  Development  at  FOC. 

This  presentation  will  provide  insight  into  the  assessment  process  of  JWARS.  The  assessment  process  includes  both 
Verification  &  Validation  (V&V)  and  Test  and  Evaluation  (T&E)  which  are  outlined  in  the  JWARS  V&V  Plan  and  JWARS 
Test  and  Evaluation  Plan  (TEP).  The  V&V  Plan,  as  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD 
VV&A  Recommended  Practices  Guide  (RPG),  modified,  where  appropriate,  for  the  JWARS  V&V  effort.  The  T&E  Plan,  as 
also  required  by  the  JWARS  ORD,  follows  the  guidance  outlined  in  the  DoD  5000.1  and  5000.2  acquisition  documents  for 
ACAT  III  level  programs  and  Automated  Information  Systems  (AISs),  modified,  where  appropriate,  for  the  JWARS  T&E 
effort.  The  Joint  Analytic  Model  Improvement  Program  (JAMIP)  is  the  proponent  of  the  JWARS  model.  The  associated 
JAMIP  Executive  Committee  (EXCOM)  and  Steering  Committee  (SC)  are  the  associated  approval  authorities  for  the  V&V 
process  and  T&E  process.  This  presentation  will  discuss  the  importance  of  the  assessment  process,  user  interface, 
verification  and  validation  activities,  test  and  evaluation  activities,  documentation  procedures  and  reporting  criteria.  The 
V&V  as  well  as  the  T&E  processes  encompass  the  internal  JWARS  office  efforts  as  well  as  the  V&V  agent  and  Operational 
Test  Agencies  interface  with  the  user  and  test  community. 

Strategies  and  Techniques  for  Automation  of  Data  Management  and  Reduction  to  Support  Real  - 
Time  and  Near  Real-Time  Data  Analysis. 

David  Blessinqer 

OSD  JCAS  JTF 

202  Cherokee  Avenue,  Suite  1 

Eglin  AFB,  FL  32542-5602 

The  JT&E  programs  like  many  other  test  and  evaluation  programs  collect  large  quantities  of  data  to  answer  measures  of 
performance  (MOPs),  measures  of  effectiveness  (MOEs),  and  program  issues.  Often  subject  matter  experts  and  the  analysts 
are  called  upon  to  provide  short  notice  or  quick-look  analyses  and  summaries  of  the  data,  MOEs,  and  MOPs.  Limited  time, 
personnel,  and  resources  can  make  this  a  rather  daunting  task.  Even  supporting  interim  and  final  reports  can  present  a 
challenge  to  the  analysis  group.  With  the  advances  in  computer  software,  a  well-designed  data  management  and  analysis 
program  can  make  report  generation  and  quick-look  support  quite  manageable.  The  key  to  efficient  use  of  computer 
resources  is  selecting  the  appropriate  software  for  the  task  at  hand.  i.e.  using  Access  for  data  management,  relationships,  and 
merging  data  while  using  the  SPSS  statistical  program  for  advanced  statistics  and  presentation  efforts. 

The  Joint  Close  Air  Support  (JCAS)  Joint  Test  Force  (JTF)  has  a  very  complex  model,  which  includes  over  260  MOPs 
and  MOEs,  to  describe  the  joint  close  air  support  process.  To  manage  the  data  and  automate  the  data  analysis,  a  relational 
database  was  developed  using  Microsoft  Access.  Access  was  able  to  mathematically  model  the  JCAS  process  by  providing 
relational  links  between  the  tables  (sub  processes).  These  relational  links  also  provided  the  capability  to  merge  test 
conditions  with  appropriate  test  measures.  The  power  of  Access  permitted  real-time  updates  of  test  measure  data  and  quick- 
look  analysis  of  test  measures  and  test  conditions.  Through  visual  basic  programming  and  export  of  test  measure  data  to 
Excel,  near  real-time  readouts  of  all  test  measure  values  and  some  descriptive  statistics  were  available  with  breakouts  by 
individual  battle  or  for  the  cumulative  test  program.  Access  was  also  used  to  provide  preliminary  marking  of  records  each 
test  measure  for  analysis.  This  relational  database  with  marked  records  was  imported  into  SPSS,  a  statistical  analysis 
package,  for  more  detailed  descriptive  analysis,  ANOVA  analysis,  and  sensitivity  studies.  Automation  and  macros  were  also 
used  in  the  SPSS  programs  to  reduce  development  and  analysis  time. 
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The  Value  of  Test  and  Evaluation 


Robert  Bowen 

Army  Evaluation  Center 
4120  Susquehanna  Ave 
Aberdeen  Proving  Ground  MD  21005-3013 
FAX  410-306-0223,  Fax  410-306-0467 
bo  wenrobert  @  usaec .  army .  mi  1 


Robert  Laughman 

Army  Evaluation  Center 

4120  Susquehanna  Ave 

Aberdeen  Proving  Ground  MD  21005-3013 

Phone,  FAX  410-306-0225,  Fax  410-306-0467 

laughmanrobert  @  usaec .  army .  mi  1 


The  value  of  Test  and  Evaluation  to  the  Acquisition  community  has  long  been  a  topic  of  discussion.  The  acquisition 
community  often  views  testing  and  evaluation  as  evidence  of  system  ineffectiveness  rather  than  as  a  means  to  discover  the 
true  capabilities  of  the  system.  The  cost  of  testing  is  historically  only  a  few  percent  of  the  total  program  cost.  The  value  of 
test  and  evaluation  is  demonstrated  with  anecdotal  examples  of  test  and  evaluation  implementing  changes  in  systems  prior  to 
production  or  in  upgrades.  The  examples  will  be  drawn  from  Army  Live  Fire  Test  and  Evaluation  programs  and  Joint  Live 
Fire  Test  Programs.  The  examples  demonstrate  discovery  of  reduced  capability  improved  as  a  result  of  testing  and 
evaluation. 


Joint  Warfighters  (JWF)  Joint  Test  and  Evaluation  ( JT&E ) 

Joy  Gibbons 

OSD  JWF  JT&E 

115  Lake  View  Pkwy,  Ste  A,  Suffolk,  VA  23435 
757-638-6113  Fax  6170 
757-638-6114  Gibbon@iwf.ite.osd.mil 

On  14  August  1997,  the  Office  of  the  Secretary  of  Defense  (OSD),  Deputy  Director,  Developmental  Test  and  Evaluation 
(DD,  DT&E),  Strategic  and  Tactical  Systems  (S&TS),  in  cooperation  with  the  Joint  Chiefs  of  Staff  and  Services,  chartered 
the  JWF  JT&E.  Over  a  four-year  period,  JWF  conducted  a  series  of  test  events  that  focused  on  joint  operations  against  time- 
sensitive  surface  targets.  Specifically,  the  JWF  JT&E: 

L  Established  a  baseline  case  by  evaluating  and  documenting  current  time-sensitive  target  processes  and  procedures  in 
realistic  operational  scenarios 

2.  Identified  and  verified  potential  deficiencies  and  opportunities  for  improvement 

3.  Identified,  installed,  and  tested  potential  improvements  in  environments  as  closely  aligned  with  baseline  measurements 
as  possible 

4.  Evaluated  the  effectiveness  and  suitability  of  the  potential  improvements 

The  JWF  JT&E  conducted  tests  in  conjunction  with  Ulchi  Focus  Lens  99,  Blue  Flag  00-2,  Ulchi  Focus  Lens  00,  and  Internal 
Look  01.  This  presentation  will  focus  on  the  JWF  test  concept,  test  methodology,  and  test  results. 

Combining  Live  and  Virtual  Simulations  to  Operationally  Test  Electronic  Countermeasures  Against 
Modern  Surface-to-Air  Missile  Systems 


Dr  Frank  Gray 

Deputy  Technical  Director 

Air  Force  Operational  Test  and 

Evaluation  Center 

8500  Gibson  Blvd  SE 

505-846-9828 

FAX  505-846-9726 

Frank.Grav@afotec.af.mil 


Mr.  Jeff  Cheney 
Deputy  Director 

AF  Electronic  Warfare  Eval  Simulator 
HQ  AFOTEC/CAD,  412TW/OL-AB 
Box  371  MZ  1100,  AF  Plant  4 
Ft.  Worth  TX  76101 
817-763-4783  FAX  817-777-4911 
ichenev@dcmdw.dcma.mil 


Captain  Jimmy  H.  Hammonds 

Project  Engineer 

Air  Force  Electronic  Warfare 

Evaluation  Simulator 

412TW/OL-AB, 

Box  371  MZ1 100,  AF  Plant  4 
Ft.  Worth,  TX  76101 
817-763-4469  FAX  817-777-4911 


ihammonds@dcmdw.dcma.mil 

This  presentation  describes  preliminary  results  from  a  FY  2002  project  funded  by  the  Threat  Systems  Integration 
Working  Group.  We  explain  the  design  and  analysis  of  a  series  of  experiments  conducted  in  the  Air  Force  Electronic 
Warfare  Evaluation  Simulator  facility.  These  experiments  were  designed  to  identify  important  and  unimportant  hardware-in- 
the-loop  modeling  considerations.  The  specific  application  is  operationally  testing  electronic  countermeasure  systems  that 
attack  modern  surface-to-air  missile  systems  using  seeker-aided  ground  guidance  schemes.  These  missile  systems  use  a 
hybrid  guidance  that  combines  target  tracking  radar  and  semi-active  seeker  inputs  within  the  tracking  loop.  The  tracking 
loop  is  closed  on  the  ground  and  guidance  commands  are  sent  to  the  missile.  Because  both  sources  can  be  used  in  a  guidance 
solution,  the  effect  of  a  countermeasure  is  difficult  to  observe  without  actually  shooting  a  missile.  Some  alternatives  to  live 
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shots  include  ground-mounted  seeker  tests  or  tests  using  a  seeker  flown  on  a  test  bed  aircraft.  But,  aside  from  other 
difficulties,  these  solutions  significantly  limit  the  ability  to  fly  operationally  realistic  test  scenarios.  An  option  that  does  not 
restrict  open-air  range  scenarios,  and  the  one  considered  here,  is  to  fly  against  a  target  tracking  radar  in  a  live  simulation, 
record  the  results,  and  then  use  those  results  in  a  virtual  hardware-in-the-loop  simulation  that  adds  a  missile  seeker.  The 
experimental  strategy  starts  with  an  initial  screening  experiment  to  sift  through  a  set  of  candidate  factors  and  identify  those 
that  could  have  significant  impacts  on  selected  responses.  Follow-on  experiments  resolve  confounding,  estimate  the  nature 
of  important  main  effects,  and  identify  important  interactions.  The  goal  is  to  produce  a  set  of  guidelines  for  operational 
testers  to  use  when  planning,  conducting,  and  evaluating  combined  tests. 


Global  Command  &  Control  System  T&E 


Ric  Harrison 

JITC,  Bldg  57305 
Ft  Huachuca,  AZ  85613 
520.538.5124  Fax:  X-5003 
harrisor@fhu.disa.mil 


Sarah  Patno 
101  Strauss  Ave 
Indian  Head,  MD 
301.744.2697  Fax:  X-2603 
patnos  @  ncr  .disa.  mil 


Mike  Koester 
JITC,  Bldg  57305 
Ft  Huachuca,  AZ  85613 
520.538-4230  fax:  X-5003 
koesterm@fhu.disa.mil 


The  Joint  Interoperability  Test  Command  (JITC)  is  forging  new  ground  as  the  Operational  Test  Agency  (OTA)  for  the 
Global  Command  and  Control  System  (GCCS).  GCCS  is  an  automated  information  system  designed  to  support  situational 
awareness  and  deliberate  and  crisis  planning  with  the  use  of  an  integrated  set  of  analytic  tools  and  flexible  data  transfer 
capabilities.  GCCS  will  be  the  single  Command,  Control,  Communications,  Computers  and  Intelligence  system  to  support 
the  Warfighter  from  the  foxhole  to  the  command  post. 

The  size  and  complexity  of  GCCS,  coupled  with  the  unique  acquisition  strategy  and  the  dynamic  schedule,  pose 
challenges  for  the  test  community.  JITC  has  developed  a  comprehensive  strategy  for  GCCS  Functional  Qualification  Testing 
(FQT)  and  Operational  Test  and  Evaluation  (OT&E).  This  strategy  is  designed  to  meet  the  unique  challenges  posed  by 
GCCS  and  provide  timely  information  to  the  Warfighter,  Department  of  Defense  (DoD)  Joint  Staff,  Director  Operational  Test 
and  Evaluation  (DOT&E),  Defense  Information  Systems  Agency  (DISA)  and  the  Milestone  Decision  Authority  (MDA). 

As  the  operational  tester  for  GCCS,  JITC  ensures  the  Warfighter's  perspective  is  captured  as  value-added  to  the 
development  process.  During  each  Field  Test  JITC  assesses  the  operational  effectiveness  and  operational  suitability  of  the 
GCCS  version  release  under  test. 

Through  interoperability  certification,  we  ensure  the  Warfighter  can  obtain  information  that  is  accurate,  timely,  and 
useful.  Based  on  the  Warfighter's  requirements  for  information  exchange  and  through  our  efforts  in  evaluating  incremental 
software  releases,  we  help  assimilate  new  and  affordable  technology  more  quickly  into  our  fight  and  win  systems. 


Mechanical  Physics  of  Failure  Initiatives 

James  Horchner  Mechanical  Engineer 

US  Army  Materiel  Systems  Analysis  Activity 

DIR,  USAMSAA,  ATTN:  AMXSY-LA 

392  Hopkins  Road,  Aberdeen  Proving  Ground,  MD  21005-5071 

Voice:  (410)  278-4490,  FAX:  (410)  278-3111 

horchner@amsaa.armv.mil 

This  paper  outlines  the  mechanical  physics-of-failure  (PoF)  initiatives  being  performed  by  the  US  Army.  The  first 
mechanical  PoF  initiative  is  the  ongoing  analysis  of  an  Army  trailer,  which  uses  an  integrated  process  of  dynamic  modeling, 
finite  element  modeling,  and  durability  analysis.  The  modeling  approach  starts  by  using  terrain  data  gathered  by  the 
Aberdeen  Test  Center  for  use  in  the  dynamic  models.  The  dynamic  model  used  in  this  project  is  multi-body  model  Dynamic 
Analysis  Design  Simulation  (DADS).  DADS  is  used  for  a  rigid-body  analysis  and  a  flexible-body  analysis,  using  finite 
element  analysis.  The  flexible-body  DADS  model  is  used  to  determine  the  dynamic  accelerations  at  all  points  on  the  trailer. 
NASTRAN  is  used  as  the  finite  element  model  in  this  project.  Finally,  the  University  of  Iowa,  Durability  and  Reliability 
Analysis  Workspace  (DRAW)  software  tool  will  be  used  to  integrate  results  from  dynamic  modeling  and  finite  element 
modeling  (i.e.,  dynamic  stress  and  strain)  for  durability  analysis.  This  project  outlines  an  approach  to  mechanical  reliability 
analysis  that  can  be  used  early-on  in  design. 

The  tools  developed  during  the  trailer  project  are  also  applicable  to  Test  &  Evaluation  (T&E)  related  issues.  The 
Improved  Ribbon  Bridge  (IRB)  and  the  Dry  Support  Bridge  (DSB)  acquisition  programs  sponsored  by  the  US  Army  Tank- 
Automotive  and  Armaments  Command,  are  utilizing  PoF  fatigue  analysis  tools  to  evaluate  the  structural  fatigue  induced  by 
physically  simulated  loads  applied  during  testing  and  compare  them  to  real-world  usage  loads.  In  this  application,  PoF  tools 
will  enable  substantial  test  cost  savings  by  serving  as  the  validation  tool  to  accredit  the  physical  simulation  Modeling  & 
Simulation  (M&S)  being  employed  on  these  programs.  Other  uses  of  PoF  in  support  of  T&E  include  Dynamic  Modeling, 
Finite  Element  Analysis  (FEA),  and  Life  Prediction  for  early  evaluations,  corrective  action  verification,  and  what-if  analyses. 
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Resampling  Statistics  and  Designed  Experiments 


Gregory  T.  Hutto  and  Mary  Vaughn 
Sverdrup  Technology  TEAS  Team 
Building  260  PO  Box  1935 
Eglin  AFB,  FL  32542-1935 
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36th  Electronic  Warfare  Squadron 

203  West  D  Avenue,  Suite  406 

Eglin  AFB,  FL  32542-6867 

(850)  882-5513 

Fax  (850)  882-5675 

Pete.vandenbosch@eglin.af.mil 


For  those  of  us  that  teach  statistics,  one  result  is  clear:  most  people  find  the  subject  difficult  and  confusing,  leading  to 
either  failing  to  apply  the  correct  methods  in  real  world  problems  or  failing  to  apply  statistics  at  all.  Dr.  Julian  Simon,  a 
founding  father  in  the  field  of  Resampling  Statistics  (1967),  believes  that  the  inherent  difficulty  in  statistics  lies  in  the 
difficulty  of  the  concepts  addressed  -  the  ideas  of  random  variation,  sampling  error,  and  the  development  of  appropriate 
reference  distributions  to  approximate  the  true  behavior  of  quantities  computed  from  an  experimental  sample. 

Dr.  Bradley  Efron,  of  Stanford  University,  independently  developed  a  general  resampling  method  he  called  the 
"bootstrap",  in  the  1970s.  The  basic  idea  is  that  all  the  information  we  have  about  a  sample  is  contained  in  that  sample;  we 
have  no  a  priori  knowledge  that  the  sample  came  from  a  specific  type  of  distribution.  Since  that’s  true,  let’s  treat  the  sample 
as  the  proxy  universe  that  all  samples  come  from.  Everything  else  in  bootstrap  follows  from  that  simple  idea.  It’s  been 
claimed  that  bootstrap  is  the  only  revolutionary  idea  to  come  along  in  statistics  since  the  1930s.  In  fact,  Fisher  seemed  to 
understand  the  philosophy  of  bootstrap  very  well.  It’s  just  that  he  didn’t  have  the  computing  power  to  make  it  practical.  For 
most  of  the  lifetime  of  statistics  as  a  discipline,  much  of  our  efforts  have  centered  around  finding  ways  of  making 
calculations  simple,  often  by  assuming  a  particular  distribution  pertains.  Now  that  we  have  all  the  calculating  power  we 
need,  we  should  shun  such  assumptions  when  unwarranted.  According  to  Simon,  the  bootstrap  with  its  theoretical 
underpinnings,  has  now  swept  the  field  of  statistics  to  an  extraordinary  extent.  The  New  York  Times  had  this  to  say: 

"  There's  no  question  but  that  it's  very,  very  important'  said  Frederick  Mosteller,  a  statistician  at  Harvard 
University..  Jerome  H.  Friedman,  a  Stanford  statistician  who  has  used  the  new  method,  called  it  the  most 
important  new  idea  in  statistics  in  the  last  20  years,  and  probably  the  last  50'.  He  added,  'Eventually,  it  will 
take  over  the  field,  I  think.'"  (Nov.  8,  1988,  Cl,  C6) 

We  are  in  the  process  of  determining  whether  Dr.  Friedman  is  correct.  Design  of  Experiments  has  revolutionized  testing 
at  the  53r  Wing,  Eglin  AFB,  but  we  continue  to  struggle  with  generating  enough  practitioners  of  the  method  to  address  all 
the  tests  undertaken  by  the  Wing.  The  chief  difficulty  lies  not  in  the  formulation  of  orthogonal  designs  (we  can  teach  that  in 
an  afternoon),  but  in  teaching  the  foundations,  mechanics  and  extensions  of  the  Analysis  of  Variance  (ANOVA)  to  analyze 
the  sample  (now  2-3  weeks). 

This  paper  represents  a  status  report  on  a  work  in  progress  -  determining  how  the  attractive  aspects  of  resampling 
statistics  can  be  applied  to  the  multivariate  problems  of  experimental  design.  We  will  summarize  the  background  of 
resampling  statistics,  and  then  classical  and  resampling  approaches  to  estimating  sample  size,  dealing  with  missing  data  in 
balanced  ANOVA  designs,  treatment  of  non-standard  MOPs  (e.g.,  percentiles  vs.  means  ),  and  the  contrast  between  teaching 
classical  ANOVA  and  multivariate  resampling. 


Joint  Global  Positioning  System  Combat  Effectiveness  (JGPSCE)  Joint  Test  and  Evaluation  (JT&E) 

Capt  Michael  W.  Kram.  USAF 

JGPSCE  JTF 

2050  2nd  Street,  SE 

Kirtland  AFB,  NM  87117-5669 

Commercial  Phone:  505-846-2811,  FAX:  505-853-1974 

michael.kram@afotec.af.mil 


On  29  July  1999,  the  Office  of  the  Secretary  of  Defense  (OSD),  Deputy  Director,  Developmental  Test  and  Evaluation 
(DD,  DT&E),  Strategic  and  Tactical  Systems  (S&TS),  in  cooperation  with  the  Joint  Chiefs  of  Staff  and  Services,  chartered 
the  JGPSCE  JT&E.  Over  a  four-year  period,  the  JGPSCE  Joint  Test  Force  (JTF)  is  conducting  a  series  of  test  events  that 
focus  on  joint  operations  where  the  Global  Positioning  System  (GPS)  is  denied  or  degraded  by  hostile  electronic  warfare 
(EW)  or  friendly  electromagnetic  interference  (EMI).  Specifically,  the  JGPSCE  JT&E  is  addressing  the  following  issues: 

Issue  1:  What  is  the  impact  of  GPS  vulnerabilities  on  the  effectiveness  of  joint  operational  missions  that  require 
precision  engagement? 

Issue  2:  What  changes  in  joint  tactics,  techniques,  and  procedures  (TTPs)  or  system-level  mitigation  techniques 
improve  or  maintain  joint  operational  mission  effectiveness  in  the  event  of  GPS  EW  and  EMI? 


179 


Test  and  Evaluation  WG-25 


Issue  3:  What  test  methodologies  can  be  employed  to  characterize  GPS  vulnerabilities  in  future  acquisition  and 
integration  programs? 

The  JGPSCE  JTF  conducted  its  second  field-test— GYPSY  BRAVO— from  1 1  Jan  02  through  25  Jan  02  at  Fallon  NAS, 
NV.  GYPSY  BRAVO  test  participants  included  Air  Force  F-16C  Operational  Test  Crews,  Air  Force  F-15E  Operational  Test 
Crews,  Navy  and  Marine  F/A-18  Operational  Crews,  and  Army  AH-64D  Test  Crew.  Crews  conducted  interdiction  missions 
in  the  context  of  a  medium-scale  contingency  scenario.  This  presentation  will  focus  on  the  GYPSY  BRAVO  test  concept,  test 
methodology,  and  test  results. 

Dynamic  Interface  Modeling  and  Simulation  System  (DIMSS)  :  Just  How  Good  Is  It? 

Captain  Michael  A.  Martinez  and  Michael  F.  Roscoe 

JSHIP  JT&E  -  Bldg  3191 

22707  Cedar  Point  Rd,  Unit  1 

Patuxent  River  NAS,  MD  20653- 

(301)  342-4936  x  131  (301)  342-4936  x  226 

martinezma2@navair.navv.mil ,  roscoemf@navair.navy.mil 

With  the  new  war  on  terrorism,  the  US  military  will  increasingly  host  Army/Air  Force  helicopter  assets  onboard  Navy 
ships.  For  experienced  Navy  helicopter  pilots,  the  shipboard  environment  is  not  a  new  realm — but  what  if  it  is  your  first  time 
to  land  your  Blackhawk  (with  Bingo  fuel)  on  a  pitching  and  rolling  FFG  (guided  missile  frigate)  deck  with  no  airborne  SAR 
support  at  twilight?  Will  you  be  able  to  follow  the  (Landing  Signalman  Enlisted)  LSE  command  to  land  in  spite  30-knot 
winds  and  a  high  sea  state?  In  these  situations,  the  Navy-certified  launch/recovery  wind  envelopes  become  of  primary 
importance — but  their  development  is  a  time-consuming  and  even  dangerous  task.  This  “Dynamic  Interface”  issue  is  one  the 
Joint  Shipboard  Helicopter  Integration  Process  (JSHIP)  was  tasked  by  Office  of  the  Secretary  of  Defense  (OSD)  to  answer. 

The  modeling/simulation  program  within  JSHIP  is  called  the  Dynamic  Interface  Modeling  and  Simulation  System 
(DIMSS).  Recent  advances  in  simulation  technology,  including  the  ability  to  host  applications  on  standard  PCs,  have 
allowed  DIMSS  to  use  the  last  two  years  to  integrate  a  variety  of  computer  models,  including  visual/aural/motion,  and  create 
a  high-fidelity  shipboard/helicopter  simulation.  The  simulation,  supported  by  NASA  Ames’  Vertical  Motion  Simulator 
(VMS),  is  designed  to  investigate  the  combination  of  a  UH-60A  and  a  Navy  Amphibious  Assault  Ship  (LHA).  Using 
extremely  limited  at-sea  test  data,  DIMSS  took  on  the  task  of  validating  the  simulation  in  applications  supplementing  flight 
test — another  possibility  is  use  in  the  training  arena.  JSHIP  used  an  analysis  of  variance  (ANOVA)  approach  to  analyze  the 
test  results.  An  international  accreditation  board  was  convened  to  examine  the  results  and  evaluate  the  fidelity  and  utility  of 
DIMSS.  This  presentation  will  focus  on  the  ANOVA  analysis  and  the  potential  to  continue  to  expand  simulation  support  of 
flight  testing. 


Measuring  Performance  of  Small  Units  with  Value  Models 


Mr.  Brian  R.  McEnanv,  FS 

Science  Applications  International  Corporation 

1710  Solutions  Drive 

McLean,  Virginia,  22102 

Phone:  703-676-5849 

FAX:  703-676-5093 

Brian.R.McEnanv@saic.com 


Irwin  Jacobs 

Science  Applications  International  Corporation 

1710  Solutions  Drive 

McLean,  Virginia,  22102 

Phone:  703-676-5849 

FAX:  703-676-5093 

Irwin  M.Jacobs@saic.com 


This  paper  presents  work  in  progress  currently  being  performed  for  Ground  Weapons  Directorate  at 
MARCORSYSCOM,  Quantico,  Virginia  by  SAIC.  It  outlines  a  methodology  for  establishing  the  baseline  capabilities  of  a 
Marine  Infantry  rifle  squad  and  subsequently  measuring  its  worth.  The  methodology  links  existing  T&O  equipment  to 
Mission  and  Individual  Performance  Standards  and  to  a  set  of  42  squad  functional  capabilities  (SFC).  An  objective  hierarchy 
of  six  functional  categories  (mobility,  lethality,  C2,  survivability,  sustainability,  and  training)  was  created  and  all  SFCs  were 
decomposed  across  the  six  FCATs.  Each  SFC  represents  one  or  more  common  tactical  behaviors  and  at  the  intersection  of 
the  SFC  with  the  FCAT,  a  unique  set  of  metrics  (MOE/MOPs)  was  developed  to  represent  the  behavior.  Each  metric  is 
linked  to  a  single  criterion,  linear  utility  function  having  arguments  directly  related  to  equipment  and/or  benchmark 
requirements  established  in  training  or  other  literature.  The  team  created  42  SFC  value  models  containing  unique  metrics 
associated  with  each  tactical  behavior.  Aggregation  of  all  SFC  valuations  over  the  six  FCATs  provide  a  baseline  squad  worth 
index  that  is  usable  for  comparing  new  technology  and/or  differing  equipment  being  considered  by  the  program  manager.  An 
application  program,  the  Infantry  Capabilities  Assessment  Model  (ICAM)  was  developed  to  implement  the  methodology  for 
the  IICS  project  office. 
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Application  of  the  Model-Test-Model  Process  to  the  Bradley  A3  Force  Effectiveness  Evaluation 

Mr.  David  Musser  Mr.  Ruben  Bustillos 

Operations  Research  Analyst  Operations  Research  Analyst 

US  Army  Test  and  Evaluation  Command  US  Army  TRADOC  Analysis  Center-WSMR 

Army  Evaluation  Center  ,  AEC-CCED  Brigade  Combat  Spt  Directorate 

4501  Ford  Ave.,  Alexandria,  VA  22302-1458  Bldg  1400,  White  Sands  Missile  Range,  NM  88002 

Ph:  703-681-0767,  Fax:  703-681-9787  Ph:  505-678-6017,  Fax:  505-678-1450 

musserdave@usaec.armv.mil  bustillr@trac.wsmr.armv.mil 

The  A3  recently  received  a  Full  Rate  production  decision,  after  undergoing  significant  DT  and  OT.  ATEC’s 
independent  evaluation  included  an  assessment  of  force  effectiveness,  which  was  based  on  results  from  the  Initial  Operational 
Test  (IOT),  along  with  pre-  and  post-IOT  modeling.  The  modeling  effort  was  conducted  by  TRAC-WSMR,  in  coordination 
with  the  ATEC.  The  modeling  and  simulation  effort  used  the  Combined  Arms  and  Support  Task  Force  Evaluation  Model 
(CASTFOREM)  to  focus  on  three  key  improvements  of  the  M2A3  Bradley  Fighting  Vehicle:  the  Improved  Bradley 
Acquisition  System  (IBAS);  the  Commander’s  Independent  Viewer  (CIV);  and  the  Fire  Control  and  Missile  Guidance 
System.  These  improvements  are  vital  components  to  the  increase  in  lethality  and  survivability  of  the  M2A3  over  the  M2A2 
version  of  the  Bradley.  The  primary  objectives  of  this  Model-Test-  Model  effort  were  to  assess  the  adequacy  of  the  proposed 
test  scenarios  prior  to  the  test,  to  address  test  requirements  and  better  understand  test  parameters  in  a  force-on-force 
environment,  use  test  data  and  results  to  calibrate  the  model  for  credibility  and  realistic  representation  of  the  tested  systems, 
and  to  extend  the  test  results  using  foreign  systems  not  available  for  the  test  event.  This  presentation  discusses  the  Bradley 
A3  Model-Test-Model  concept  as  applied  to  the  Bradley  A3,  a  brief  summary  of  overall  force  effectiveness  evaluation  and 
results,  including  a  discussion  of  pre-IOT  CASTFOREM  modeling  effort,  results  of  the  IOT  and  the  model  calibration  effort, 
and  a  summary  of  the  post-IOT  modeling  effort.  In  addition,  the  lessons  learned  for  both  T&E  and  modeling  will  be 
presented. 

Herding  Cats — Leading  an  Operations  Analyst  Reinvention  Effort  in  a  Dynamic  Electronic  Warfare 
Group. 

Capt  August  G.  Roesener 

36th  Electronic  Warfare  Squadron 

203  West  D  Avenue,  Suite  406  ,  Eglin  AFB,  FL  32542-6867 
(850)  882-5513,  Fax  (850)  882-5675 
August.Roesener@eglin.af.mil 

As  Ralph  Waldo  Emerson  noted,  “Fear  always  springs  from  ignorance.”  Change  is  generally  a  feared  and  fought  aspect 
of  operations  in  an  office  or  unit,  especially  when  the  changes  is  instituted  by  superiors  and  forced  downward  to  the  lower 
levels.  If  the  workers  do  not  understand  the  need  or  purpose  for  the  change,  it  will  probably  never  be  fully  adopted  at  the 
lower  levels.  Without  adopting  the  changes,  an  office  or  unit  cannot  incorporate  new  ideas,  methodologies  and  processes 
which  could  increase  efficiency  and  productivity. 

This  presentation  documents  and  discusses  some  of  the  these  issues  in  aspects  of  the  53rd  Electronic  Warfare  Group 
(EWG)  as  it  adopts  and  incorporates  a  different  (not  new)  approach  for  conducting  Test  and  Evaluation  in  a  constantly 
changing  environment.  This  methodology,  called  Experimental  Design,  was  enthusiastically  adopted  by  the  leadership  of  the 
53  EWG;  however,  its  incorporation  as  a  standard  testing  methodology  was  not  openly  accepted  at  the  lower  levels.  As  a 
result,  many  man-hours  were  expended  educating  members  of  the  lower  levels  in  this  new  methodology.  This  presentation 
will  deal  with  many  aspects  of  incorporating  a  large  change  in  a  dynamic  unit,  including  the  perils  and  pleasures  of 
reinventing  test  processes  from  traditional  methods,  clarifying  the  vision,  focusing  the  efforts,  squelching  rumors,  ensuring 
accurate  communication,  organizational  inertia  and  promoting  acceptance  at  all  levels. 

Anti-personnel  Landmine  Alternatives  (APLA)  Non-self  Destruct  Alternative  (NSD-A)  Target 
Activation  Study 

Mr.  Thomas  Ruth 

USAMSAA,  Attn:  AMXSY-CS 
392  Hopkins  Road,  APG,  MD  21005 
410-278-2797 

The  Target  Activation  Study  was  conducted  to  describe  the  performance  and  effectiveness  of  APLA  minefields 
employed  with  and  without  target  activation,  where  target  activation  is  defined  as  the  event  when  an  intruder  (the  target) 
autonomously  activates  the  lethal  effects  without  the  intervention  of  a  human  controller.  The  analysis  applied  a  triad  of  live. 
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virtual  and  constructive  simulations  to  address  key  sensitivity  issues  which  include:  minefield  density,  intruder  speeds 
through  the  minefield,  controller  timelines  in  chemical  protective  gear  and  the  impact  of  interruptions  in  the  communication 
link  between  controller  and  the  deployed  minefield  (s).  The  study  concluded  that  NSD-A  munitions  with  Target  Activation 
outperform  NSD-A  munitions  without  Target  Activation  under  the  following  conditions:  when  the  communications  link  is 
interrupted;  when  the  operator  was  in  MOPP  gear;  for  significant  increases  in  the  intrusion  speed  for  the  OPFOR,  and  for 
operational  timeline  delays  from  mine  trigger  to  detonation  command  greater  than  10  seconds.  Without  the  Target  Activation 
feature,  NSD-A  munitions  are  not  militarily. 

Millennium  Challenge  ’02  Data  Instrumentation  Techniques 
Neil  F.  Sleevi 

TRADOC  Analysis  Center  -  Ft.  Leavenworth 
255  Sedgwick  Ave.,  Ft.  Leavenworth,  KS  66027 
(913)  684-9210,  FAX  (913)  684-9191 
sleevin@trac.army.mil 


Army  Transformation  Experiment  ’02  (ATEx02)  is  the  Army  Experimentation  Campaign  Plan  (AECP)  event  supporting 
the  US  Joint  Forces  Command  (USJFCOM)  experiment  Millennium  Challenge  2002  (MC02).  MC02  is  a  major  field 
experiment  integrating  Service  and  Special  Operations  Forces  capabilities,  consisting  of  both  live  and  simulated  forces. 
MC02  is  designed  to  demonstrate  the  US  forces  capabilities  to  conduct  Rapid  Decisive  Operations  (RDO)  in  the  2007 
timeframe. 

This  presentation  describes  data  instrumentation  and  collection  requirements  and  analytical  approach  required  for  one 
specific  ATEX02  issue.  The  issue  surrounds  augmentation,  reorganization,  and  additional  capabilities  required  for  an  Army 
corps  headquarters  (HQS)  to  serve  as  a  Joint  Task  Force  (JTF)  HQS.  A  corps  HQS  must  have  a  mission-capable 
organization  with  an  organization  and  supporting  staff  prepared  to  assume  the  role  of  a  JTF  in  a  combined  operational 
environment.  JTF’s  typically  require  augmentation.  For  a  conventional  Corps  staff,  this  is  normally  an  uncomfortable 
adjustment.  Traditionally,  a  Corps  staff  has  relied  upon  another  U.S.  headquarters  (Army)  to  resource,  synchronize  and 
provide  guidance,  direction  and  approval.  The  presentation  describes  novel  techniques  for  data  instrumentation  and 
addresses  data  collection  issues  in  ATEx02  surrounding  experimentation,  observation,  and  analysis.  It  addresses  MC02 
jointly  collected  data  and  results  analysis  that  will  be  required  for  this  important  Army  issue.  It  describes  how  Army  analysts 
will  leverage  data  collection  from  GCCS  (COP),  GCCS  (13),  and  TBMCS  at  all  the  main  and  forward  sites,  e.g.  JTF 
headquarters  (main  and  forward)  and  functional  Joint  commands.  This  effort  will  require  LAN  probes  such  as 
SPECTRUM™,  log  files,  “sniffer”  data,  and  wide  area  network  (WAN)  probes.  The  presentation  also  describes  innovative 
techniques  for  obtaining  data  and  “screen  captures”  from  the  Information  Work  Space™  (IWS)  collaboration  environment  at 
each  of  these  Joint  sites  and  afloat  required  during  MC02. 

Future  Combat  Systems  (FCS)  and  the  Joint  Distributed  Engineering  Plant  (JDEP)(A  Potential 
Venue  for  FCS  Joint  Experimentation) 

John  W.  Tindall 

MITRE  Corporation 
1 1493  Sunset  Hill,  Reston  VA.  20190 
(703)883-5389,  FAX  (703)883-1370 
jtindall@mitre.org 

The  Army  is  accelerating  the  acquisition  of  FCS  to  meet  the  transformation  goals  of  the  Chief  of  Staff  of  the  Army 
(CSA),  and  DoD.  Concurrently,  OSD  and  other  joint  agencies  are  implementing  JDEP.  JDEP  will  provide  a  distributed  test¬ 
bed  for  Service  developers,  testers,  and  warfighters.  The  time  is  right  for  the  Army  to  try  to  bring  these  two  programs 
together  to  support  joint  warfighting  concept  exploration,  and  Army  acquisition  officials  in  achieving  a  FCS  First  Unit 
Equipped  (FUE)  in  FY2008.  JV2020  promulgates  a  network  centric  warfare  environment  that  can  potentially  provide 

unprecedented  levels  of  situational  awareness  to  the  lowest  tactical  echelons.  FCS  network  centric  concepts  have  to  be 
demonstrated  to  support  acquisition  decisions.  Due  to  the  complexity  of  the  problem,  the  Army  should  develop  small 
“scoping”  experiments  to  evaluate  net-centric  warfare.  This  presentation  will  explore  three  compelling  reasons  why  the  Army 
should  incorporate  a  JDEP  construct  in  the  FCS  Test  and  Evaluation  Master  Plan  (TEMP).  First,  by  employing  JDEP  the 
Army  will  show  commitment  to  FCS  interoperability,  and  a  means  to  assess  network  centric  warfare  development  in  a  joint 
context.  Secondly,  it  will  be  a  method  to  incrementally  test  Command,  Control  and  Communications  On  The  Move 
(C30TM);  thus,  illuminating  some  of  the  sensor  to  shooter  linkages,  responsiveness,  latency,  and  throughput  issues  that  the 
developer  will  have  to  consider  for  FCS.  Finally,  JDEP  could  support  a  compressed  acquisition  timeline  by  integrating  live, 
virtual,  and  constructive  simulations  for  testing  FCS  C4ISR  concepts.  The  presentation  will  conclude  with  a  “way  ahead”  for 
future  FCS  C4ISR  testing  approaches. 
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Verification ,  Validation ,  and  Accreditation  of  MUVES/S2  for  U.S.  Army  System  Evaluations  of 
Ground  Combat  and  Munitions  System 

Wendy  A.  Winner 

USARL,  AMSRL-SL-BA 
APG,  MD  21005-5068 
410-278-6339,  F:  6307 
wendv@arl.army.mil 

For  DoD  and  service  decision  makers,  technically  astute  and  fiscally  sound  testing  is  critical  to  accurately  quantify  the 
survivability  and  lethality  of  U.S.  ground  combat  and  munitions  systems  in  analysis  models  and  wargames.  At  the  weapon 
system  level,  deliberate  Army  experimentation  has  been  used  to  fill  critical  data  voids  and  to  develop  new  model  algorithms. 
These  efforts  have  proven  instrumental  to  incrementally  extending  the  applicability  of  the  tri-service  AJEM/  MUVES-S2 
analysis  code  for  ballistic  survivability/vulnerability/lethality  analyses  of  U.S.  Army  and  foreign  weapon  systems.  These 
rigorous  efforts  are  providing  a  critical  foundation  for  analyzing  new  and  emerging  weapon  system  technologies.  Algorithm 
and  code  advances  are  also  supporting  Analyses  of  Alternatives,  U.S.C.  Title  10  Live  Fire  Testing,  and  DoD  5000.2.  In 
February  2001,  the  Army  Test  and  Evaluation  Command  (ATEC)  accredited  MUVES/S2  for  use  in  system  effectiveness 
evaluations  to  support  the  Bradley  M2A3  program  and  for  use  in  shot  line  analyses,  live  fire  pre-shot  predictions,  and 
generating  full-view  system-level  metrics  for  combat  systems  and  munitions.  In  December  2001,  the  Army  Research 
Laboratory  presented  another  compelling  MUVES/S2  validation  package  to  ATEC  for  the  BAT  program.  These  efforts  will 
be  leveraged  to  support  other  munitions  in  Army  development  such  as  GMLRS  and  P3I  BAT.  This  paper  succinctly 
describes  the  analytical  approach,  testing  methods,  analysis  techniques,  and  modeling  advances  that  are  being  applied  to 
support  the  evaluation  of  ground  combat  and  munitions  systems  for  current  and  future  frontiers. 


C3  Test  Driver  Scenario  Development 


Mr.  Paul  W.  Works,  Jr. 
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CPT  Steven  Cram 
TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 

(913)  684-9221,  FAX  (913)  684-9191 
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The  Command,  Control,  and  Communications  Test  Driver  program  was  initiated  in  response  to  a  Deputy  Undersecretary 
of  the  Army  for  Operations  Research  (DUSA-OR)  tasking.  The  US  Army  Test  and  Evaluation  Command  (ATEC),  the  US 
Army  Simulation,  Training  and  Instrumentation  Command  (STRICOM),  and  the  US  Army  Electronic  Proving  Ground  (EPG) 
lead  the  C3  Test  Driver  Program.  The  Program  involves  key  participants  within  the  TRADOC  Analysis  Center  (TRAC),  the 
Central  Technical  Support  Facility  (CTSF),  the  US  Army  Operational  Test  Command  (OTC),  and  the  TRADOC  Threat 
Support  Directorate  (TSD). 

The  objective  is  to  support  developmental,  integration,  and  operational  testing  of  Army  Battle  Command  System 
(ABCS)  components  using  standard  models,  standard  mission/message  threads,  and  standard  scenarios. 

The  scenario  development  effort  was  tasked  in  Phase  I  of  the  C3  Test  Driver  Program  (FY01)  to  produce  an  unclassified, 
brigade-level  scenario  to  be  used  as  the  background  for  C3  Test  Driver  message  generation  and  traffic.  This  scenario  was 
located  on  the  National  Training  Center  and  featured  a  Force  XXI  brigade  against  an  opposing  gorces  division.  Key  events 
were  identified  within  a  scripted  time-ordered  event-list  to  initiate  various  mission/message  threads.  C3  Test  Driver  uses  this 
message  traffic  to  stimulate  real  systems  under  test,  evaluate  their  performance,  and  facilitate  developmental  and  integration 
testing. 

Classified  corps-division  and  brigade-level  scenarios  are  being  developed  for  use  in  Phases  II  and  III  of  this  program. 
These  scenarios,  and  vignettes  identified  within  them,  will  use  a  dynamic  simulation  and  a  robust  set  of  doctrinal 
mission/message  threads  to  additionally  support  operational  testing  and  training. 
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Predator  Antiarmor  System  Analysis  of  Alternatives  (AoA) 

Dr.  George  Akst 

Deputy  Director,  Studies  &  Analysis  Div, 

MCCDC 

3300  Russell  Road, 

Quantico,  VA  22134-5130 
703-784-4914,  aks  t  g  @ mccdc . usmc . mi  1 

The  Marine  Corps  is  approaching  a  fielding  decision  on  the  Predator,  a  system  designed  to  satisfy  the  Marine  Corps’ 
Short-Range  Assault  Weapon  (SRAW)  requirements.  Because  of  the  significant  cost  growth  of  the  Predator  since  its  last 
Milestone,  and  its  failure  to  meet  reliability  criteria  in  operational  testing,  the  Marine  Corps  wants  to  explore  less  expensive 
alternatives  to  the  Predator  through  a  milestone  III  Analysis  of  Alternatives  (AoA).  To  support  the  AoA,  this  study  assessed 
the  cost  and  operational  effectiveness  of  a  variety  of  SRAW  alternatives.  Because  few,  if  any,  of  these  alternatives  meet  all 
of  the  current  Marine  Corps  requirements,  this  analysis  quantified  the  operational  risk  associated  with  each  of  the 
alternatives,  and  investigated  possible  mitigations  for  this  risk. 

The  analysis  first  identified  a  large  number  of  potential  alternatives  for  initial  screening.  Based  on  performance 
characteristics,  and  rough  orders  of  magnitude  of  cost,  this  list  was  pared  down  to  four  basic  alternatives.  Counting  the  three 
distinct  variants  of  one  of  these,  Panzerfaust,  there  were  a  total  of  six  alternatives  chosen  for  further  analysis.  We  also 
developed  a  wide  spectrum  of  scenarios  in  which  to  compare  the  operational  effectiveness  of  these  alternatives.  The  next 
step  evaluated  the  effectiveness  of  the  overall  MAGTF  in  each  of  these  scenarios  using  a  high-resolution  combat  model  know 
as  CASTFOREM.  At  the  same  time,  we  examined  the  life-cycle  costs  of  each  of  these  alternatives.  Based  on  the 
effectiveness  in  the  scenarios,  and  the  costs,  we  developed  additional  alternatives/excursions  to  examine  to  try  to  mitigate  the 
risk  involved  in  selecting  an  alternative  that  did  not  meet  all  of  the  SRAW  requirements.  Using  all  of  this  input,  we 
formulated  the  overall  summary  and  conclusions. 

Addressing  the  Cost  and  Value  of  C41  Information  in  AoAs 

Joseph  F.  Auletta 

AFMC  OAS/DR 

3550  Aberdeen  Avenue,  SE,  Kirtland  AFB,  NM  87117-5776 
505-846-8214  (fax  505-846-5558).  joseph.auletta@kirtland.af.mil 

The  nature  of  major  Air  Force  system  acquisitions  is  substantially  changing.  The  systems  themselves  are  much  more 
information  dependent,  and  many  of  the  Analyses  of  Alternatives  (AoAs)  for  these  acquisition  systems  must  address  a  trade 
of  money  spent  on  information  vs.  money  spent  on  warheads.  This  presentation  will  focus  upon  several  significant  steps  the 
Air  Force  has  taken  to  improve  how  it  analyzes  the  value  of  information  in  AoAs,  some  still-needed  improvements,  and  some 
problem  areas  as  we  continue  to  adapt  the  AoA  process  for  C4I  systems.  The  specific  areas  of  discussion  include  how  to  cost 
C4I  support  to  a  weapon  system  and  how  to  measure  the  “value”  of  C4I  in  a  pre-warfare  environment. 

Using  Analysis  of  Alternatives  (AoAs)  to  Determine  the  Most  Cost-Effective  Systems  for  Acquisition 
(Providing  Decision  Makers  Useful  Information) 

Tony  R.  Bellach 

Office  of  Aerospace  Studies,  AFMC/DR 
3550  Aberdeen  Ave,  SE 
Kirtland  AFB,  NM  87117-5776 

505-846-8103  (fax)505-846-5558),  tonv.bellach@kirtland.af.mil 

This  presentation  discusses  the  process  currently  used  by  the  United  States  Air  Force  to  conduct  an  Analysis  of 
Alternatives  (AoA)  in  support  of  system  acquisition  and  requirements  development.  AoAs  can  help  justify  the  need  for 
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starting,  stopping,  or  continuing  an  acquisition  program.  They  are  done  because  decision-makers  need  reliable,  objective 
assessments  of  the  options  for  meeting  real  mission  needs.  AoAs  identify  potentially  viable  solutions  and  provide 
comparative  cost-effectiveness  assessments  of  each  solution  to  a  baseline,  typically  representing  current  systems  and  their 
funded  improvements.  AoAs  are  a  big — but  not  the  only — factor  considered  in  selecting  a  final  solution.  The  final  decision, 
in  addition  to  considering  cost-effectiveness  and  military  worth,  must  consider  domestic  policy,  foreign  policy,  technological 
maturity  of  the  solution,  the  environment,  the  budget,  and  a  host  of  additional  factors.  AoAs  also  provide  a  foundation  for 
developing  operational  requirements,  concepts  of  operational  employment,  a  test  and  evaluation  plan  for  the  preferred 
alternative(s),  and  much  additional  information  of  interest  to  a  program  office — if  or  when  one  is  formed. 

AoAs  compare  alternatives  using  proven  methodologies  in  estimating  their  ability  to  satisfy  the  identified  mission  needs 
at  a  given  cost.  The  results  of  these  two  analyses  are  combined  to  produce  cost-effectiveness  comparisons.  The  effectiveness 
analysis  is  built  on  a  hierarchy  of:  (1)  Accomplish  campaign  objective  based  on  military  strategy-e.g.,  halt  advance;  (2) 
Broad  mission  tasks  (MTs)  derived  from  the  mission  needs  (e.g.,  kill  tanks);  (3)  Measures  of  effectiveness  (MOEs)  indicating 
how  well  the  mission  tasks  are  performed  (e.g.,  weapons  expended  for  each  tank  killed);  and  (4)  Measures  of  performance 
describing  alternatives'  fundamental  capabilities  (e.g.,  weapon  delivery  error).  The  life  cycle  cost  analysis  estimates  how 
much  each  alternative  will  cost  during  its  lifetime.  AoAs  need  to  also  tie  in  the  military  utility  of  competing  solutions.  During 
the  presentation  sample  measures  of  effectiveness  and  measures  of  performance  will  be  discussed  for  various  types  of 
munitions,  aircraft,  space  systems,  and  UAV  systems. 

Applying  a  Balanced  Scorecard  (BSC)  Structure  and  Approach  for  the  GCSS-AF  Analysis  of 
Alternatives 


Robert  H.  “Chris”  Chisolm 

ANSER 

1250  Academy  Park  Loop,  Suite  1 19, 
Colorado  Springs,  CO  80910 
716-670-4660  (fax  719-670-4677) 
chris.chisolm@anser.org 


Bruce  D.  Wyman 

Northrop  Grumman  Information  Technology 
6940  South  Kings  Highway,  Suite  210, 
Alexandria,  VA  22310-3344 
703-971-3103  x  162  (fax  703-971-6370) 
b  wyman  @  northropgrumman.com 


This  presentation  provides  brief  overviews  of  both  the  traditional  Analysis  of  Alternatives  (AoA)  process  and  the 
Balanced  Scorecard  (BSC)  process.  The  authors  then  present  a  methodology  for  adapting  and  applying  BSC  techniques  to 
conduct  operational  effectiveness/utility  analyses  for  AoAs.  The  methodology  is  presented  as  a  series  of  step-by-step 
procedures  resulting  in  a  completed  BSC  framework  for  accomplishing  an  AoA  operational  effectiveness  analysis.  The 
presentation  concludes  by  identifying  benefits  to  be  gained  by  applying  BSC  techniques  to  the  AoA  process,  as  well  as 
identifying  cautions  that  the  practitioner  should  keep  in  mind. 


Crafting  an  Analysis  of  Alternatives  for  Milestone  B:  Thought  Process  and  Requirements 

Peter  A.  Davidson 

MITRE  Corporation 

261 1  Jefferson  Davis  Highway 

Arlington,  VA  22202-3911 

703-604-7021  (fax  703-604-8711),  pdavidson@mitre.org 

As  a  combat  modeler,  did  you  ever  wonder  why  your  tasker  contains  such  difficult  questions?  Where  do  the  writers 
come  up  with  these  ideas?  As  a  system  moves  through  the  acquisition  process,  varying  analysis  needs  to  be  done  to  gain 
insights  into  system  capabilities  and  requirements  to  support  acquisition  decisions.  For  Milestone  B,  the  alternatives  being 
considered  are  the  different  components  that  comprise  the  winning  system  from  the  Analysis  of  Multiple  Concepts.  The 
example  used  for  this  discussion  will  be  the  Objective  Individual  Combat  Weapon.  For  example,  should  the  weapon  have  a 
20mm  single  shot  air-bursting  munition  with  secondary  kinetic  energy  weapon  or  25mm  semi-auto  air-bursting  munition 
without  a  kinetic  energy  weapon?  Other  factors,  which  need  to  be  considered,  such  as  training,  cost  of  ammunition,  human 
factors,  etc.  will  be  discussed. 
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Combat  Rescue  Analysis  of  Alternatives 

Mai  David  Fulk 

AC2ISRC/A-58 

130  Andrews  Street,  Suite  118 

Langley  AFB,  V A  23665 

757-764-9983 

david.fulk@langlev.af.mil 

HQ  ACC  completed  the  USAF  Combat  Rescue  (CR)  Analysis  of  Alternatives  (AoA)  this  past  year.  The  presentation 
will  discuss  the  operational  effectiveness  performed  during  the  study.  This  AoA  used  many  tools,  including  tool-kit  models, 
new  simulations,  spreadsheet  analysis,  value  models,  and  subject  matter  expert  examination.  The  variety  of  tools  provided 
insights  of  alternative  effectiveness  across  the  breadth  of  the  recovery  vehicle  operations  spectrum.  The  briefing  will 
concentrate  on  the  variety  of  tools  and  how  they  were  used,  although  actual  results  will  be  presented  where  appropriate. 

USAF  Combat  Rescue  (CR)  Analysis  of  Alternatives  (AoA)  Lessons  Learned 

Mai  David  Fulk 

AC2ISRC/A-58 

130  Andrews  Street,  Suite  118 

Langley  AFB,  VA  23665 

757-764-9983 

david.fulk@langlev.af.mil 

This  presentation  will  address  lessons  learned  during  the  USAF  Combat  Rescue  (CR)  Analysis  of  Alternatives  (AoA). 
The  presenter  led  the  ACC  team  that  recently  completed  the  CR  AoA.  This  study  was  lauded  by  several  organizations  as  an 
example  of  how  to  do  an  AoA;  especially  impressive  given  the  comparatively  short  time  and  funds.  During  the  course  of  this 
study,  the  presenter  gathered  numerous  lessons  on  what  went  well  and  what  did  not  work  as  well.  Although  every  AoA  is 
different,  these  lessons  should  provide  useful  insights  into  the  planning  and  execution  of  other  AoAs. 

Collaborative  W&A  Process  for  Ao As 

Lynda  Liptak 

Office  of  Aerospace  Studies,  AFMC/DRC 
3550  Aberdeen  Ave,  SE 
Kirtland  AFB,  NM  87117-5776 
505-846-8312  (fax  505-846-5558) 
lynda.liptak@kirtland.af.mil 

The  Office  of  Aerospace  Studies  (OAS)  supports  the  modeling  and  simulation  (M&S)  accreditation  process  associated 
with  Analysis  of  Alternatives  (AoAs).  The  Air  Force  is  currently  conducting  an  AoA  to  replace  the  aging  fleet  of  HH-60 
Blackhawk  helicopters  for  Air  Combat  Command’s  Search  and  Rescue  mission.  A  major  milestone  leading  to  the  final  Air 
Force  Requirements  Oversight  Council’s  decision  in  the  spring  of  2001  on  the  AoA  is  the  accreditation  of  the  M&S  used  to 
support  the  AoA.  The  purpose  of  the  accreditation  package  is  to  measure  the  confidence  in  the  M&S  that  is  used  to  support 
the  AoA.  OAS  led  the  accreditation  development  for  the  HH-60  replacement  AoA  by  providing  an  M&S  Verification, 
Validation  and  Accreditation  (VV&A)  process  that  exceeded  the  accreditation  requirements  established  in  Air  Force 
Instruction  AFI  16-1001.  OAS  developed  a  methodology  to  carefully  scrutinize  and  document  the  M&S  strengths  and 
limitations  before  and  after  the  analysis  in  an  AoA.  This  was  then  processed  into  a  formal  VV&A  report  that  supported  the 
accreditation  briefing  to  the  accreditation  authority.  This  paper  will  discuss  the  accreditation  process  and  lessons  learned  to 
improve  the  quality  and  efficiency  of  an  AoA  M&S  analysis.  Individuals  interested  in  model  VV&A  should  attend  to  gain 
insight  into  this  new  technique  of  supporting  the  accreditation  process. 

The  Development  of  the  Future  Combat  Systems  (FCS)  Analysis  of  Alternatives  Tasking  Directive 
LTC  Mark  Malcom  John  F.  Tindall 

DUSA(OR),  Acquisition  Analysis  Support  Division  MITRE  Corporation,  1 1493  Sunset  Hill,  Reston,  VA  20190 

703-604-7047  (fax  703-604-7047),  703-883-5389,  F:703-883-1370,  itindall@mitre.org 

mark.malcom@saalt.armv.mil 


186 


Analysis  of  Alternatives  WG-26 


This  presentation  will  provide  an  overview  of  the  development  of  the  memorandum  that  directs  the  conduct  of  Army 
requirements,  acquisition  and  affordability  analyses  needed  to  support  the  Defense  Acquisition  Board  (DAB)  Milestone  (MS) 
B  decision  review  of  an  FCS  system-of-systems  in  June  2003.  It  will  address  the  methodology  use  to  frame  the  analytical 
issues  for  a  complex  system-of-systems  acquisition  program.  Moreover,  the  presentation  will  demonstrate  how  the  directive 
attempts  to  synchronize  and  integrate  analyses  for  a  compressed  acquisition  timeline.  The  analysis  and  directive  for  the  MSB 
decision  in  June  2003  will  lead  to  an  FCS  MS  C  in  2006.  Ultimately,  this  will  support  the  Chief  of  Staff  of  the  Army 
guidance  to  achieve  an  FCS  First  Unit  Equipped  (FUE)  in  2008,  Initial  Operational  Capability  (IOC)  in  2010,  and  eventual 
realization  of  full  Objective  Force  capabilities. 

Measuring  Performance  of  Small  Units  with  Value  Models 

Mr.  Brian  R.  McEnanv,  FS  Irwin  Jacobs 

Science  Applications  International  Corporation  Science  Applications  International  Corporation 

1710  Solutions  Drive  1710  Solutions  Drive 

McLean,  Virginia,  22102  McLean,  Virginia,  22102 

703-676-5849  (fax  703-676-5093)  703-676-5849  (fax  703-676-5093), 

brian.r.mcenany@saic.com  irwin.m.iacobs@saic.com 

This  paper  presents  work  in  progress  currently  being  performed  for  Ground  Weapons  Directorate  at 
MARCORSYSCOM,  Quantico,  Virginia  by  SAIC.  It  outlines  a  methodology  for  establishing  the  baseline  capabilities  of  a 
Marine  Infantry  rifle  squad  and  subsequently  measuring  its  worth.  The  methodology  links  existing  T&O  equipment  to 
Mission  and  Individual  Performance  Standards  and  to  a  set  of  42  squad  functional  capabilities  (SFC).  An  objective  hierarchy 
of  six  functional  categories  (mobility,  lethality,  C2,  survivability,  sustainability,  and  training)  was  created  and  all  SFCs  were 
decomposed  across  the  six  FCATs.  Each  SFC  represents  one  or  more  common  tactical  behaviors  and  at  the  intersection  of 
the  SFC  with  the  FCAT,  a  unique  set  of  metrics  (MOE/MOPs)  was  developed  to  represent  the  behavior.  Each  metric  is 
linked  to  a  single  criterion,  linear  utility  function  having  arguments  directly  related  to  equipment  and/or  benchmark 
requirements  established  in  training  or  other  literature.  The  team  created  42  SFC  value  models  containing  unique  metrics 
associated  with  each  tactical  behavior.  Aggregation  of  all  SFC  valuations  over  the  six  FCATs  provide  a  baseline  squad  worth 
index  that  is  usable  for  comparing  new  technology  and/or  differing  equipment  being  considered  by  the  program  manager.  An 
application  program,  the  Infantry  Capabilities  Assessment  Model  (ICAM)  was  developed  to  implement  the  methodology  for 
the  IICS  project  office. 


Anti-Personnel  Landmine  Alternatives  Non-Self  Destruct  Alternative  Target  Activation  Study 


Lin  Townsel 

U.S.  Army  Materiel  Systems  Analysis 
Activity,  Attn:  AMXSY-CS 
392  Hopkins  Road 

Aberdeen  Proving  Ground,  MD  21005 

410-278-5328, 

townsel  @amsaa. army. mil 


Peter  Norman 

U.S.  Army  Materiel  Systems  Analysis 
Activity,  Attn:  AMXSY-CS 
392  Hopkins  Road 

Aberdeen  Proving  Ground,  MD  21005 

410-278-6637, 

norman@amsaa.armv.mil 


Thomas  Ruth 

U.S.  Army  Materiel  Systems  Analysis 
Activity,  Attn:  AMXSY-CS 
392  Hopkins  Road 

Aberdeen  Proving  Ground,  MD  21005 
410-278-5344,  truth@amsaa.armv.mil 


The  Target  Activation  Study  was  conducted  to  describe  the  performance  and  effectiveness  of  Anti-Personnel  Landmine 
Alternatives  (APLA)  minefields  employed  with  and  without  target  activation,  where  target  activation  is  defined  as  the  event 
when  an  intruder  (the  target)  autonomously  activates  the  lethal  effects  without  the  intervention  of  a  human  controller.  The 
analysis  applied  a  triad  of  live,  virtual,  and  constructive  simulations  to  address  key  sensitivity  issues,  which  include: 
minefield  density,  intruder  speeds  through  the  minefield,  controller  timelines  in  chemical  protective  gear,  and  the  impact  of 
interruptions  in  the  communication  link  between  controller  and  the  deployed  minefield(s).  The  study  concluded  that  Non-Self 
Destruct  Alternative  (NSD-A)  munitions  with  Target  Activation  outperform  NSD-A  munitions  without  Target  Activation 
under  the  following  conditions:  when  the  communications  link  is  interrupted;  when  the  operator  was  in  MOPP  gear;  for 
significant  increases  in  the  intrusion  speed  for  the  OPFOR,  and  for  operational  timeline  delays  from  mine  trigger  to 
detonation  command  greater  than  10  seconds.  Without  the  Target  Activation  feature,  NSD-A  munitions  are  not  militarily 
equivalent  to  current  anti-personnel  mines. 
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Analysis  of  Alternatives  (AoA)for  C4ISR  Systems 

COL  Patrick  Vve 

U.S.  Army  DUSA(OR) 

25 1 1  Jefferson  Davis  Highway 
Arlington,  VA  22202 
703-604-711 1  (fax  703-604-8177) 
patrick.vve@saalt.armv.mil 

The  Analysis  of  Alternatives  (AoA)  is  the  single  most  important  analytical  event  in  the  material  acquisition  process.  The 
purpose  of  the  AoA  is  to  assess  the  cost  and  operational  effectiveness  of  a  potential  new  system;  and  an  AoA  is  required  for 
both  combat  systems  and  for  C4ISR  systems.  In  the  past,  information  systems,  such  as  radios,  situation  awareness  systems, 
and  sensors,  were  often  considered  “enablers”  for  combat  systems  and  a  lesser  standard  of  analysis  was  required.  In  recent 
years  there  has  been  a  requirement  to  capture  the  operational  benefit  of  such  information  systems  in  models  and  in  AoAs. 
This  paper  discusses  (1)  U.S.  Army  C4ISR  systems,  (2)  Key  analysis  issues  related  to  C4ISR  systems,  (3)  Key  C4ISR  tools 
and  techniques,  (4)  Example  C4ISR  analysis  results,  and  (5)  Tool  enhancements  for  the  future. 

Verification ,  Validation ,  and  Accreditation  of  MUVES/S2  for  U.S.  Army  System  Evaluations  of 
Ground  Combat  and  Munitions  System 

Wendy  A.  Winner 

US  Army  Research  Laboratory 
AMSRL-SL-BA 

Aberdeen  Proving  Ground,  MD  21005-5068, 

410-278-6330  (fax  410-278-6307) 
wendv@arl.armv.mil 

For  DoD  and  Service  decision  makers,  technically  astute  and  fiscally  sound  testing  is  critical  to  accurately  quantify  the 
survivability  and  lethality  of  U.S.  ground  combat  and  munitions  systems  in  analysis  models  and  wargames.  At  the  weapon 
system  level,  deliberate  Army  experimentation  has  been  used  to  fill  critical  data  voids  and  to  develop  new  model  algorithms. 
These  efforts  have  proven  instrumental  to  incrementally  extending  the  applicability  of  the  tri-Service  AJEM/MUVES-S2 
analysis  code  for  ballistic  survivability/vulnerability/lethality  analyses  of  U.S.  Army  and  foreign  weapon  system 
technologies.  Algorithm  and  code  advances  are  also  supporting  Analyses  of  Alternatives,  U.S.C.  Title  10  Live  Fire  testing, 
and  DoD  5000.2.  In  February  2001,  the  Army  Test  and  Evaluation  Command  (ATEC)  accredited  MUVES/S2  for  use  in 
system  effectiveness  evaluations  to  support  the  Bradley  M2A3  program  and  for  use  in  shot  line  analyses,  live  fire  pre-shot 
predictions,  and  generating  full-view  system-level  metrics  for  combat  systems  and  munitions.  In  December  2001,  the  Army 
Research  Laboratory  presented  another  compelling  MUVES/S2  validation  package  to  ATEC  for  the  BAT  program.  These 
efforts  will  be  leveraged  to  support  other  munitions  in  Army  development  such  as  GMLRS  and  P3I  BAT.  This  paper 
succinctly  describes  the  analytical  approach,  testing  methods,  analysis  techniques,  and  modeling  advances  that  are  being 
applied  to  support  the  evaluation  of  ground  combat  and  munitions  systems  for  current  and  future  frontiers. 
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Military  to  Civilian  Billet  Conversion  in  the  USMC 

Dr  George  Akst 

Deputy  Director 

Studies  and  Analysis  Division,  MCCDC 
3300  Russell  Road,  Quantico,  VA  22134-5130 
703-784-4914,  AkstG@mccdc.usmc.mil 

MARCORSYSCOM  has  developed  a  proposal  to  convert  Marine  billets  into  civilian  billets  to  achieve  greater 
effectiveness  and  efficiency  for  the  command.  In  particular: 

The  proposal  is  to  convert  adequate  number  of  professional  acquisition  workforce  military  (officer  and  enlisted) 
positions  within  the  SYSCOM  only  (so  that  it  excludes  MCTSSA  and  AVTC)  to  government  civilians  to  achieve  an  overall 
ratio  of  on-board  military  to  civilian  of  70:30. 

The  purpose  of  this  analysis  is  to  investigate  the  proposal  to  determine  the  underlying  merits  and  costs. 

This  analysis  has  found  that  there  is  substantial  merit  to  the  proposal.  It  should  achieve  improved  effectiveness  at  the 
Systems  Command  and  provide  a  more  stable  workforce.  At  the  same  time,  there  should  be  adequate  number  of  Marines 
remaining  at  the  command  to  provide  the  needed  expertise.  Finally,  it  will  return  Marines  to  the  operating  forces  in  numbers 
that  could  make  a  difference  for  the  field  grade  officer  population. 

There  is,  however,  a  cost  to  the  Marine  Corps  for  this  proposal.  We  estimate  about  $5.2M  per  year  O&MMC  for  civilian 
pay  and  allowances.  There  would  be  a  small  offset  to  this  in  savings  in  training  costs.  There  may  also  be  cost  savings  to 
systems  development  as  a  result  of  becoming  more  efficient,  but  these  could  not  be  quantified  at  this  point.. 

Regression  of  Cost-Dependent  CER’s 

Timothy  P.  Anderson  Raymond  P.  Covert 

The  Aerospace  Corporation  The  Aerospace  Corporation 

15409  Conference  Center  Drive,  CHI -4 10,  Suite  600  15409  Conference  Center  Drive,  CHI -4 10,  #  600 

Chantilly,  VA  20151  Chantilly,  VA  20151 

703-633-5141,  fax  703-633-5006  703-633-5245,  fax  703-633-5006 

Timothv.P.Anderson@aero.org  Ravmond.P.Covert@aero.org 

This  paper  proposes  a  revolutionary  new  way  to  estimate  the  cost  of  programmatic  WBS  elements,  such  as  systems 
engineering,  integration  and  test,  and  program  management  (SEITPM)  in  a  way  that  more  credibly  accounts  for  the  statistical 
uncertainty  in  these  estimates.  Historically,  SEITPM  has  often  been  estimated  as  a  function  of  the  non-programmatic  costs, 
such  as  spacecraft  recurring  hardware  cost,  while  spacecraft  subsystem  costs  have  been  estimated  as  a  function  of  cost  drivers 
such  as  weight.  SEITPM  cost  estimating  relationships  (CER)  are  usually  derived  from  actual  spacecraft  costs,  but  since  we 
use  estimated  spacecraft  costs  when  applying  these  CER’s,  we  tend  to  misrepresent  the  total  cost  variance,  leading  to  total 
cost  distributions  that  are  misleading.  To  remedy  this  problem,  we  should  derive  SEITPM  CER’s  as  a  function  of  estimated 
spacecraft  costs.  This  method  adjusts  the  total  cost  variance,  leading  to  more  accurate  total  cost  distributions. 

Tutorial  on  General  Error  Regression  Methods 

Timothy  P.  Anderson 

The  Aerospace  Corporation 

15409  Conference  Center  Drive,  CHI -4 10,  Suite  600 
Chantilly,  VA  20151 

703-633-5141,  fax  703-633-5006,  Timothv.P.Anderson@aero.org 


Historically,  cost  analysts  have  often  used  the  framework  of  ordinary  least  squares  (OLS)  to  develop  typical  single¬ 
variable  and  multi-variable  cost  estimating  relationships.  Unfortunately,  the  OLS  framework  has  many  limitations  that 
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restrict  its  usefulness.  For  example,  OLS  requires  the  assumption  that  errors  be  additive  (i.e.,  yj  =  b0  +  biXj  +  6|)  and 
normally  distributed  with  constant  variance.  This  means  the  standard  error  of  the  estimate  must  be  expressed  as  a  uniform 
dollar  amount  across  the  range  of  estimation.  Another  limitation  arises  when  using  OLS  to  model  curvilinear  data  with  a  log- 
linear  model.  For  example,  curved  data  is  modeled  by  calculating  the  natural  logarithm  of  y  and  x,  applying  OLS  to  the  log 
data,  then  transforming  the  resulting  model  back  into  unit  space  (i.e  ln(yi)  =  b0  +  biln(Xi)  +  £j  =>  ys  =  ax^-e*).  This  requires 
the  assumption  that  curvilinear  data  have  multiplicative  errors.  Moreover,  this  means  the  standard  error  of  a  log-linear  model 
must  be  expressed  as  a  percentage  of  the  estimate.  The  general  error  regression  framework,  on  the  other  hand,  contains  none 
of  these  restrictions.  General  error  regression  has  been  in  the  literature  for  many  years,  but  has  become  much  more  practical 
in  today’s  computing  environment.  General  error  regression  separates  the  question  of  whether  estimating  errors  should  be 
additive  or  multiplicative  from  the  question  of  whether  the  shape  of  the  cost  estimating  relationship  should  be  linear  or  non¬ 
linear.  In  addition,  general  error  regression  enables  the  cost  analyst  to  be  able  to  model  practically  any  functional  form 
(including  y  =  a  +  bxc,  y  =  a  +  bx,  etc.).  Finally,  general  error  regression  statistics  can  directly  compare  any  two  functional 
forms  in  terms  of  standard  error  of  the  estimate  and  goodness  of  fit. 

Measuring  the  value  of  prewar  C4I ,  and  costing  the  contribution  of  C4I  to  the  weapon  system 

Mr  Joseph  F.  Auletta 

Office  of  Aerospace  Studies,  AFMC/DR 

3550  Aberdeen  Ave  SE,  Kirtland  AFB,  NM  87717-5778 

505-846-8214,  fax:  505-846-5558,  Joseph . Auletta @ kirtland . af . mi  1 


The  nature  of  major  Air  Force  system  acquisitions  is  substantially  changing.  The  systems  themselves  are  much  more 
information  dependent,  and  many  of  the  Analyses  of  Alternatives  (AoA’s)  for  these  acquisition  systems  must  address  a  trade 
of  money  spent  on  information  vs.  money  spent  on  warhead.  This  presentation  will  focus  upon  several  significant  steps  the 
Air  Force  has  taken  to  improve  how  it  analyses  the  value  of  information  in  AOA’s,  some  still  needed  improvements,  and 
some  problem  areas  as  we  continue  to  adapt  the  AoA  process  for  C4I  systems.  The  specific  areas  of  discussion  include  how 
to  cost  C4I  support  to  a  weapon  system  and  how  to  measure  the  “value”  of  C4I  in  a  pre-warfare  environment. 

MIDS  Cost  Estimating  for  Milestone  II  to  LRIP II 

Mr  Dennis  Baer  Maj  Justin  Moul  USAF 

Northrop  Grumman  Corporation  AFCAA,  1111  Jefferson  Davis  Highway,  #403 

2100  S.  Washington  Blvd,  Arlington  VA  22204  Arlington,  VA  22202 

703-312-2149,  dbaer@northrupgrumman.com  (703)  602-9263,  Justin.moul@pentagon.af.mil 

MIDS  is  a  AC  AT  ID  program  that  began  development  back  in  the  early  90’ s.  Methodologies  with  emphasis  on  Non¬ 
recurring  and  recurring  PME  will  be  traced  from  Milestone  II  through:  a)  Naval  Center  for  Cost  Analysis  (NCCA)  model,  b) 
LRIP  revised  model,  and  c)  current  contractor  pricing  model.  Lessons  learned  will  be  provided  with  emphasis  of  discussion 
on  the  various  NCCA  studies  and  learning/rate  curves  used. 

Defense  Budget:  How  was  the  Funding  Spent? 

Mr  Gary  Billen 

U.S.  General  Accounting  Office 
441  G  St,  NW,  Washington,  DC  20854 
214-777-5703 

Approved  abstract  not  available  at  printing. 

Defense  Budget:  DODys  Portion  of  the  FY01  Emergency  Supplemental 

Mr  Bruce  Brown  Mr  George  Duncan 

U.S.  General  Accounting  Office  U.S.  General  Accounting  Office 

441  G  St,  NW,  Washington,  DC  20854  441  G  St,  NW,  Washington,  DC  20854 

202-512-8606,  fax  202-512-2501,  drownrb@gal.gov  202-512-7270,  fax  202-512-2501,  duncang@gao.gov 

With  the  events  of  September  11,  2001,  homeland  defense  and  antiterrorism  efforts  have  significantly  impacted  on 
Defense’s  budget.  For  example,  the  FY  01  Emergency  Supplemental  Act  provided  Defense  with  $17.5  billion  in 
appropriations  for  broadly  described  activities  such  as  increased  situational  awareness  and  increased  worldwide  posture.  The 
purpose  of  this  presentation  is  to  illustrate  what  the  U.S.  General  Accounting  Office  (GAO)  found  as  the  process  that  linked 
the  $17.5  billion  to  requirements  and  obligations. 
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Forecasting  Research  and  Development  Program  Budgets  using  the  Weibul  Distribution 
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Norden  (1970)  demonstrates  that  the  Rayleigh  function  can  model  manpower  on  research  and  development  (R&D) 
programs.  Several  research  efforts  extend  his  work  to  modeling  R&D  program  expenditures.  The  Rayleigh  distribution, 
which  is  a  degenerative  of  the  Weibull  distribution,  suffers  from  some  theoretical  limitations  that  makes  the  Weibull  function 
a  better  model  for  R&D  program  expenditures.  Using  128  completed  R&D  programs,  we  develop  regression  models  to 
predict  the  requisite  Weibull  scale  and  shape  parameters.  To  determine  the  Weibull  model’s  budget  profile  forecasting 
capacity,  we  compare  the  completed  R&D  program  budget  profiles  to  Weibull  modeled  budget  profiles  and  report  an  average 
correlation  of  0.607.  To  determine  the  significance  of  our  results  we  compare  the  same  128  completed  program  budget 
profiles  to  Rayleigh  modeled  budget  profiles.  Using  the  Weibull  in  lieu  of  the  Rayleigh  model  we  improve  initial  budget 
profile  projections  on  average  58%. 


Comparison  of  Spacecraft  Cost  Model  Correlation  Coefficients 


Raymond  P.  Covert 

The  Aerospace  Corporation 

15409  Conference  Center  Drive,  CHI -4 10 
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Timothv.P.Anderson@aero.org 


The  Unmanned  Space  Vehicle  Cost  Model  Revision  7  (USCM  7)  and  Small  Satellite  Cost  Model  version  2000  (SSCM 
2000)  contain  Cost  Estimating  Relationships  (CER)  for  spacecraft  bus  components  and  subsystems,  integration  and  test,  and 
program  level  costs.  Each  of  the  CERs  in  the  respective  models  contains  inherent  regression  errors  (expressed  in  percent 
error)  that  represent  the  uncertainty  associated  with  the  CER.  These  uncertainties  are  used  in  risk  analysis  to  capture  the  total 
estimating  uncertainty  of  a  spacecraft  bus  estimate.  A  previously  published  paper,  "Correlation  Coefficients  for  the 
Unmanned  Spacecraft  Cost  Model,"  provided  the  values  of  correlation  derived  from  the  residuals  of  the  CERs  as  well  as  a 
method  of  calculating  correlation  between  CER  pairs.  In  this  paper  the  correlation  coefficients  are  derived  for  SSCM  2000 
and  compared  to  the  correlation  coefficients  derived  for  USCM  7.  This  paper  provides  the  correlation  coefficients  for  the 
SSCM  2000,  differences  between  corresponding  correlation  coefficients  in  the  models,  and  the  distribution  of  the  correlation 
coefficients  of  both  models.  The  paper  asserts  that  correlation  of  uncertainties  in  each  model,  while  following  a  similar  and 
random  distribution  pattern,  is  not  part  of  a  causal  relationship,  is  not  similar  between  the  two  models,  and  is  unique  to  a 
particular  model. 


Joint  Cost  and  Performance  Systems  (J-CAPS) 

Mr  Ray  Droll  Mr.  Dennis  Baer 

Northrop  Grumman  Corporation  Northrop  Grumman  Corporation 

2100  S.  Washington  Blvd,  Arlington  VA  22204 
703-312-2149,  dbaer@northrupgrumman.com 

Approved  abstract  not  available  at  printing. 

Methodologies  in  a  Task  Based  Framework 
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This  presentation  will  discuss  research  in  progress  that  focuses  on  the  development  of  a  methodology  to  assess  the  costs 
and  benefits  of  the  activities/tasks  that  comprise  several  scenarios  produced  by  the  employment  of  the  Defense  Modeling  and 
Simulation  Office  Military  Domain  Representation  Framework  (MDRF).  The  MDRF  scenarios  exercise  the  range  of  Army 
operations,  forces,  and  environments.  The  study  that  serves  as  the  basis  for  this  presentation  seeks  to  identify  1]  the  measures 
used  to  assess  mission  effectiveness;  2]  the  activities  that  lead  to  mission  effectiveness  in  the  context  of  the  identified 
scenarios;  3]  the  costs  of  the  components  of  the  activities;  and  4]  the  issues  encountered  in  the  use  of  an  activity-based 
costing  methodology  versus  a  more  traditional  costing  methodology  in  the  task-based  framework  relating  performance  to 
effectiveness. 


Models  to  Improve  Readiness  &  Cost  Estimating 


Mr.  Bernard  C.  Price 

US  Army  CECOM 
AMSEL-PE-SA 
Fort  Monmouth,  NJ  07703 
732-532-8752,  fax  732-532-2993 
priceb  @  mai  1 .  monmouth .  ar  m y .  mi  1 

An  Army  concept  known  as  Simulation  and  Modeling  for  Acquisition,  Requirements  and  Training  (SMART)  is 
improving  the  implementation  of  acquisition  policy  and  collaboration  across  a  variety  of  Army  communities.  SMART  can 
help  to  achieve  greater  operational  readiness  for  less  life  cycle  cost  and  field  systems  quicker.  This  presentation  covers  five 
models  that  improve  acquisition  logistics  policy  implementation  and  collaboration  to  achieve  SMART  readiness  and  total 
ownership  cost  goals.  Any  U.S.  Government  agency  or  its  contractors  may  use  these  models.  Three  of  the  five  models  are 
Army  standard  models.  The  other  two,  developed  by  the  Army  Communications-Electronics  Command  are  standalone  tools 
that  can  also  link  to  the  Army  standard  models.  An  introduction  covering  each  of  the  five  models  is  identified  in  Table  1  will 
be  presented. 


Table  1:  Linked/Integrated  Army  Models 
Acronym  Model  Name 

ASOAR  Achieving  a  System  Operational  Availability  Requirement 

SESAME  Selected  Essential  item  Stockage  for  Availability  Method 

COMPASS  Computerized  Optimization  Model  for  Predicting  and 
Analyzing  Support  Structures 

ACEIT  Automated  Cost  Estimating  Integrated  Tools 

LCET  Logistics  Cost  Estimating  Tool 


Type 
Readiness 
Readiness 
Readiness  and  Cost 

Cost 

Cost 


All  of  the  models  support  early,  informed  decision-making  across  the  domains  of  many  different  communities  to  help 
provide  collaborative  analyses.  ASOAR,  SESAME  and  COMPASS  are  models  that  optimize  supportability  to  Ao 
requirements  or  goals.  ASOAR  can  be  used  early  enough  in  the  acquisition  cycle  to  evaluate  and  generate  RAM  and 
supportability  requirements.  ASOAR  analyzes  the  mission  reliability  aspect  of  RAM,  while  COMPASS  and  SESAME 
analyze  the  logistics  reliability  aspect  of  item  demand  rates  requiring  equipment  support.  COMPASS,  LCET  and  ACEIT  are 
models  that  can  be  used  together  to  provide  a  structured  approach  to  optimize  supportability  and  concurrently  compute  Life 
Cycle  Costs  (LCC).  The  integrated  use  of  the  COMPASS  and  LCET  prior  to  fielding  significantly  improves  the  fidelity  and 
credibility  of  logistics  cost  estimates  relative  to  existing  cost  analysis  models.  LCET  also  contains  macros  that  support 
earlier-on  logistics  cost  estimates  and  its  integrated  use  with  ACEIT  to  cover  the  non-logistics  cost  estimates  improves  LCC 
estimating.  Models  that  improve  LCC  estimating  aid  in  the  analysis  and  management  of  reducing  total  ownership  costs. 


Evaluation  of  Software  Cost  Risk:  A  look  beyond  the  size  parameter 
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Within  the  Department  of  Defense,  there  is  a  tendency  to  estimate  the  risk  associate  with  software  development  of  in 
terms  of  size  ranges.  Bounding  the  estimate  in  terms  of  source  lines  of  code  (or  function  points)  could  be  a  viable  method  of 
capturing  risk  if  all  other  aspects  associated  with  software  development  were  held  constant.  However,  there  are  a  number  of 
additional  factors  that  may  impact  the  veracity  of  software  cost  estimation.  Developmental  standards  (e.g.,  ISO  9001  and 
MILSTD  2 167 A),  developmental  methods  (e.g.,  waterfall,  spiral,  and  incremental),  coding  methods  (e.g.,  third  or  fourth 
generation  language,  visual  or  code-generating  techniques,  and  designing  for  reuse),  and,  personnel  and  environmental 
effects  (e.g.,  skill  level  of  software  engineers,  potential  productivity  of  development  team,  multi-location  development)  are 
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all  examples  of  knowledge  bases  and  parameters  that  can  affect  the  risk  associated  with  the  estimate.  We  hypothesize,  in 
translating  program  risk  into  cost,  there  is  a  tendency  to  focus  on  the  parameterization  of  size  to  the  exclusion  of  these  other, 
equally  necessary  assumptions.  Moreover,  we  hypothesize  the  impact  on  standard  software  cost  estimation  equations  due  to 
variations  in  values  assumed  for  non-volume  variables  may  have  a  significant  effect  on  overall  assessments  of  program  cost 
risk  -  potentially  more  impact  than  volume  assumptions. 

To  translate  software-intensive  programs  into  dollar  costs,  assumptions  about  these  other  factors  must  be  made.  This 
presentation  will  put  forward  a  framework  to  evaluate  the  effects  of  varying  other  input  values  and  determining  the  impact  on 
a  software  development  cost  estimate.  From  a  macro  sense,  a  researcher  might  parameterize  a  host  of  non-volume  variables 
to  determine  the  potential  risk  potential.  It  is  our  supposition  that  this  project  will  be  more  useful  to  the  estimating 
community  by  quantifying  or  calibrating  the  risk  of  minor  to  major  changes  in  specific  variable  assumptions  and  their  impact 
to  the  software  cost  estimate.  We  will  focus  on  particular  types  or  subsets  of  the  potential  factors,  as  the  list  of  non-volume 
variables  is  quite  large. 


OSD  (PA&E)  Force  Structure  and  Installation  Support  Cost  Models 

Mr.  John  Walker 

Management  Analysis,  Inc. 

2070  Chain  Bridge  Road 
Vienna,  VA  22182 
Phone:  703.506.0505 
Fax:  703.506.1436 
iwalker@hq.mainet.com 

This  presentation  will  describe  the  capabilities  and  limitations  of  recently  developed  support  cost  models  for  military 
forces  and  installations/bases.  Two  models  have  been  developed  by  OSD  (PA&E)  for  the  purpose  of  investigating  the 
relative  costs  associated  with  various  installation  and  military  force  structure  alternatives.  The  Force  Support  Cost  System 
allows  Force  Structure  Analysts  to  determine  the  operating  and  support  costs  associated  with  Army,  Navy,  Marine  Corps 
(and  soon  Air  Force)  forces  and  to  estimate  the  cost  impacts  of  changes  in  force  structure  and  tables  of  equipment.  The 
Installation  Support  Cost  Model  provides  a  capability  for  Force  Analysts  to  evaluate  the  costs  associated  with  various  types 
of  Army,  Navy  and  Air  Force  installations  and  to  estimate  the  impact  of  Base  Realignment  or  Closure  Actions  on  installation 
support  costs.  These  applications  will  support  rapid,  credible,  analysis  and  evaluation  of  the  effects  on  resources  and  budgets 
that  result  from  major  force,  support  and  infrastructure  changes. 
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Information  System  Risk  Assessment  and  Countermeasure  Allocation  Strategy 

Don  Buckshaw 

EG&G  Technical  Services 
16156  Dahlgren  Road 
P.O.  Box  552 
Dahlgren  VA,  22448 

(540)-663-9323,  dbuckshaw@egginc.com 

This  presentation  details  work  in  progress  to  conduct  a  Risk  Assessment  and  Countermeasure  Allocation  Strategy  for  a 
military  information  system.  This  is  a  Joint  Chiefs  of  Staff  J6  directed  effort  that  includes  an  inter-agency  team  with 
members  from  the  National  Security  Agency  (NSA),  Defense  Intelligence  Agency,  and  Defense  Information  Systems 
Agency.  This  effort  is  intended  to  establish  a  methodology  for  conducting  risk  assessments  at  NSA  that  is  repeatable, 
tractable,  and  defendable.  A  baseline  version  of  the  Global  Command  and  Control  System  was  used  to  vet  the  process.  The 
methodologies  used  for  the  assessment  evolved  over  time  and  incorporated  information  assurance  testing,  influence 
networks,  fault  trees,  multi-attribute  utility  analysis,  cost-benefit  analysis,  and  a  budget-constrained  optimization.  The 
presentation  will  also  address  difficulties  and  insights  into  the  development  of  a  mathematical  model  that  satisfies  three 
different  organizations,  accounts  for  positive  countermeasure  effects  on  the  adversary,  includes  negative  effects  that 
countermeasures  impart  on  the  warfighter,  and  includes  both  Peace  and  Wartime  scenarios. 

Selecting  Force  Protection  Initiatives  Using  Value  Focused  Thinking 

Captain  Stephen  Chambal 

AFIT/ENS,  BLDG  640 
2950  P  ST 

WPAFB,  OH  45433-7765 

Voice:  (937)  255-6565  ext  4314,  DSN  785-6565  ext  4314 
Fax:  (937)  656-4943,  DSN  986-4943 
stephen.chambal@afit.edu 

Decision  makers  responsible  for  enhancing  force  protection  throughout  the  Department  of  Defense  require  additional 
insight  when  selecting  force  protection  ideas,  concepts,  or  technologies  to  pursue  with  constrained  resources.  They  are  faced 
with  multiple  criteria  and  have  multiple  objectives  yet,  have  no  defensible,  objective,  and  repeatable,  selection  process  to 
assist  them  in  making  their  decisions. 

The  value-focused  thinking  (VFT)  process  is  appropriate  for  providing  the  necessary  decision  insight  to  commanders  and 
is  applicable  in  the  force  protection  arena.  To  prove  the  VFT  process  is  appropriate  and  viable  for  force  protection  decision 
makers,  this  thesis  focuses  on  constructing  a  value  model,  scoring  alternatives,  and  analyzing  the  results  for  the  Air  Force 
Force  Protection  Battlelab. 

The  United  States  Air  Force  Force  Protection  Battlelab  (FPB),  at  Lackland  Air  Force  Base,  Texas,  has  a  mission  to 
“rapidly  identify  and  prove  the  military  worth  of  innovative  [force  protection]  ideas  which  improve  the  ability  of  the  Air 
Force  to  execute  its  core  competencies  and  Joint  Warfighting”  (AFI  10-1901,  1997:2).  This  mission  necessitates  the 
evaluation  of  many  force  protection  related  ideas  in  a  time,  personnel,  and  fiscally  constrained  environment.  Prior  to  this 
thesis  effort,  the  FPB  had  no  objective,  defensible,  repeatable  initiative  selection  process,  now  they  do.  This  thesis  has  thus 
proven  that  using  VFT  as  a  decision  assistance  methodology  for  force  protection  decision  makers  allows  them  to  make 
objective  decisions  regarding  which  innovative  force  protection  ideas  can  contribute  the  most  value  to  their  mission.  It 
provides  justifiable  defense  for  their  decisions  and  enables  future  selection  decisions  with  the  same  objectivity  and 
defensibility. 
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Brigade  Assault  Bridging  Analysis  -  BABA 

MAJ  Patrick  J.  Delanev 

Center  for  Army  Analysis 

6001  Goethals  Road 

Fort  Belvoir,  VA  22060-5230 

703.806.5618,  fax:  703.806.5726  or  703.806.5727 

delanev@caa.armv.mil 


In  realigning  the  Force  Structure,  rigorous  and  comparative  analysis  will  be  the  hallmark  to  input  in  the  decision  making 
process.  Systems  being  considered  for  acquisition  will  have  to  illustrate  their  worth  to  the  Army  before  investments  can  be 
made.  Recently,  the  Vice  Chief  Staff  of  the  Army  asked  ODCSOPS  to  evaluate  the  Wolverine  against  the  Armored  Vehicle- 
Launched  Bridge  when  considering  Force  Structure  and  Cost.  ODCSOPS  asked  CAA  to  assist  in  the  analysis.  The  purpose 
of  the  Brigade  Assault  Bridging  Analysis  (BABA)  Study  was  to  perform  the  comparative  analysis  of  the  capabilities  of  the 
A  VLB  against  the  Wolverine  in  a  worst-case  scenario.  Given  the  extensive  requirement  for  bridging  assets  in  Korea,  CAA 
used  a  Northeast  Asia  scenario.  CAA  considered  the  maintenance  readiness,  survivability  and  gap  crossing  capabilities  in 
developing  the  model.  The  result  of  this  study  was  a  tool  that  allowed  decision  makers  to  assess  their  particular  risk  pattern 
and  see  the  impact  on  Operational  Planning  in  a  Northeast  Asia  scenario.  This,  ultimately,  provided  input  to  the  greater 
Force  Structure  and  Capital  Investment  analysis  that  ODCSOPS  provided  to  the  Vice  Chief  of  Staff. 


Decisions  and  their  Underlying  Processes  in  the  Joint  Warfare  System  (JWARS) 


Harvey  F.  Graf 

The  MITRE  Corporation 
1820  Dolley  Madison  Blvd. 
McLean,  VA  22102-3481 
Phone:  (703)  883-5745 
FAX:  (703)  883-1370 
E-mail:  graf@mitre.org 


Chuck  Burdick 
JWARS  (Lockheed  Martin) 
1555  Wilson  Blvd.  (Suite  620) 
Arlington,  VA  22209 
Phone:  (703)  696-9490 
FAX:  (703)  696-9563 
chuck.burdick@lmco.com 


Lt  Col  Gregory  McIntyre,  (USAF) 
JWARS 

1555  Wilson  Blvd.  (Suite  620) 
Arlington,  VA  22209 
Phone:  (703)  696-9490 
FAX:  (703)  696-9563 
gregorv.mcintvre@osd.pentagon.mil 


As  might  be  expected  in  a  next  generation  Theater  Campaign  simulation,  JWARS  makes  a  large  number  of  decisions  at 
multiple  echelons.  Furthermore,  it  must  do  so  over  a  To  compound  this  problem,  JWARS  has  been  tasked  to  operate  with 
realistic  C4ISR.  This  has  meant  operating  only  with  an  initial  knowledge  base  and  perceived  information  form  interaction 
with  the  participants  and  the  environment  in  the  model.  That  has  resulted  in  decision  making  under  various  degrees  of 
uncertainty  depending  on  the  breadth  and  extent  of  the  decisions.  The  decisions  are  also  being  made  in  a  two  (or  more)  sided 
environment  where  each  opponent  is  attempting  to  thwart  the  plans  of  the  other.  Because  of  this  complexity  (and  because  of 
a  requirement  to  run  up  to  1000  times  faster  than  real  time),  JWARS  has  employed  several  different  methods  of  decision 
making  and  treated  them  as  components  of  a  larger  complex  system  of  systems. 

JWARS  forces  are  represented  at  a  level  of  detail  and  a  breadth  that  has  not  been  attempted  before  in  long  running. 
Theater-level  models.  This  has  meant  a  much  larger  number  of  units  to  command  and  control  over  a  much  longer  time 
period  with  consideration  of  an  integrated  logistics  system,  stretching  all  the  way  back  to  CONUS.  Consequently,  there  are 
more  and  more  complex  decisions  to  be  addressed  than  in  past  theater  models.  This  presentation  describes  the  types  of 
decisions  being  made  in  JWARS,  the  algorithmic  methods  underpinning  them,  and  some  of  the  successes  and  failures  that 
have  been  achieved  to  date.  Specifically,  the  presentation  addresses: 


•  JTF  Commander  decisions  related  to  Phase  and  ROE  changes  (rule  sets) 

•  C4ISR  fusion  and  intelligence  generation  (matrix  algebra  and  rule  sets) 

•  Land  Course  of  Action  Selection  (game  theory,  simulation,  and  fuzzy  sets) 

•  ATO  (linear  programs,  greedy  algorithms,  and  rule  sets) 

•  Maritime  and  Missile  Defense  (multi-attribute  optimization  techniques  and  rule  sets) 

•  Intra-theater  Scheduler  (shortest  path  (by  time)  in  a  constrained  network) 

This  presentation  also  addresses  the  question  of  where  might  JWARS  go  from  here  and  describes  some  efforts  related  to 
further  improve  decision  making  in  JWARS.  These  include  applying  Bayesian  networks  to  problems  of  aggregation,  agent 
based  complexity  theory  to  assessment  of  situations  and  outcome  prediction,  and  circumstance  descriptors  to  the  generation 
of  plan  fragments  in  an  uncertain  situation. 
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Effects-Based  Modernization:  Combat  Air  Forces'  Planning  and  Programming  Analytical  Tool 
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Air  Combat  Command  has  completed  the  development  of  an  analytical  methodology  that  supports  effects-based 
planning  and  programming  for  the  current  Combat  Air  Forces  Program  Objective  Memorandum,  Mission  Area  Plans,  and  the 
Air  Force  Capabilities  Investment  Strategy.  This  briefing  will  illustrate  that  methodology  and  some  useful  techniques  for 
presenting  output. 

The  methodology  evaluates  the  performance  of  today's  Combat  Air  Forces  against  Defense  Planning  Guidance  threats. 
First,  a  series  of  task  hierarchies  are  used  to  evaluate  the  criticality  of  campaign-  and  system-level  capability  shortfalls.  Then 
existing  and  postulated  systems  are  evaluated  for  their  contribution  to  CAF  capability.  Next,  each  system  is  evaluated  to 
determine  which  capabilities  require  improvement  based  on  current  performance.  Material  solutions  are  then  proposed  that 
would  reduce  or  eliminate  a  system  deficiency  currently  contributing  to  a  capability  shortfall.  Finally,  materiel  solutions  are 
scored  against  a  system  capability  hierarchy  whose  attributes  are  system  and  subsystem  performance  parameters  and  whose 
objective  is  to  maximize  system  performance  across  a  spectrum  of  conflict. 


Effects-Based  Modernization:  CAF  Center  of  Gravity  Neutralization  Capabilities  Hierarchy 
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Air  Combat  Command’s  Combat  Air  Forces'  Planning  and  Programming  Analytical  Tool  (CAFPPAT)  uses  a  strategy-to- 
task  framework  to  determine  the  magnitude  of  Combat  Air  Forces  capability  shortfalls  in  standard  Defense  Planning 
Guidance  scenarios.  This  brief  addresses  the  development  of  the  offensive  (neutralization  of  targets)  capabilities  piece  of  that 
framework. 

The  analysis  of  a  series  of  OPLANs,  the  Air  Force  Task  List,  the  Universal  Joint  Task  List,  the  Modernized  Integrated 
Database,  and  inputs  from  COMAFFOR  campaign  planners  have  produced  a  set  of  about  150  capabilities  (target  sets  to 
neutralize).  These  capabilities  are  organized  functionally  into  the  effects  the  Air  Force  may  desire  versus  potential 
adversaries.  The  highest  level  of  the  framework  is  based  on  John  Warden's  Five  Strategic  Rings.  These  tasks  capture  the 
offensive  capabilities  required  for  the  Air  Superiority,  Global  Attack,  and  (a  subset  of  the)  Information  Warfare  mission 
areas.  This  framework  was  used  across  three  Combatant  Commands  to  evaluate  Combat  Air  Forces  capability  shortfalls  in 
four  AORs.  The  output  is  an  integrated  (across  AORs)  set  of  Combat  Air  Forces  Needs. 


Effects-Based  Modernization:  Combat  Air  Force's  Aircraft/System  Capabilities  Hierarchy 
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Air  Combat  Command's  Combat  Air  Forces'  Planning  and  Programming  Analytical  Tool  (CAFPPAT)  uses  a  strategy-to- 
task  framework  to  determine  the  magnitude  of  Combat  Air  Forces  capability  shortfalls  in  standard  Defense  Planning 
Guidance  scenarios.  This  paper  addresses  the  development  of  the  aircraft/system  representation  piece  of  that  framework. 
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Each  of  the  CAF’s  offensive  systems  has  been  modeled  hierarchically  in  order  to  determine  the  performance  shortfalls  at 
the  system-  and  subsystem-levels.  System  subject  matter  experts  have  built  these  assessment  frameworks.  They  are 
organized  into  six  high-level  system  functions: 

-  Effectiveness  -  Survivability  (Combat  Attrition)  -  Safety  (Non-Combat  Attrition) 

-  Logistical  Footprint  -  Sortie  Rate  -  Mission  Capable/ Availability  Rate 

The  Aircraft  Capabilities  Hierarchy  was  used  to  evaluate  the  capability  shortfalls  existing  in  sixteen  aircraft  across  four 
mission  areas.  The  output  is  an  integrated  (across  aircraft  and  mission  areas)  set  of  Combat  Air  Forces  Needs. 

Decision  Analysis  Support  for  the  Global  Combat  Support  System  —  Army 

William  K.  Klimack.  COL,  Director  ORCEN,  MAJ  S.  Vann-Olejasz 

and  CPT  Frank  Snyder 

Operations  Research  Center  of  Excellence 

Department  of  Systems  Engineering 

United  States  Military  Academy,  West  Point,  NY  10996 

(845)-938-5529,  DSN  688-5529,  FAX  (845)-938-5665 


The  Global  Combat  Service  Support-Army  (GCSS-A)  will  be  the  business  automation  enabler  for  the  Army  for 
interfacing  and  integrating  information  and  enterprise  systems  across  the  combat  support  and  combat  service  support  mission 
areas,  and  support  situational  awareness  for  command  and  control.  An  Automated  Information  System,  it  consists  of  both 
hardware  and  software.  Work  to  select  an  alternative  was  initially  based  on  criteria  and  analytical  techniques  that  would  be 
challenging  to  defend.  Application  of  Decision  Analysis  techniques  provided  a  both  an  improved  understanding  of  the 
decision  situation  as  well  as  a  solid  quantitative  basis  for  the  decision. 

USMC  Engagement  Strategy  for  the  Horn  of  Africa 

Capt.  Michael  D.  Lepson  Maj.  Darrin  L.  Whaley 

MCCDC  (Studies  &  Analysis  Div)  MCCDC  (Studies  &  Analysis  Div) 

3300  Russell  Rd.,  Quantico,  VA  22134-5130  3300  Russell  Rd.,  Quantico,  VA  22134-5130 

(703)  784-6004  (phone)  -3547  (fax)  (703)  784-6722  (phone)  -3647  (fax) 
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The  study  examines  the  peacetime  engagement  activities  in  the  focus  countries  to  the  U.S.  Marine  Corps  component  of 
CENTCOM  (USMARCENT)  in  which  Marine  forces  play  either  a  principal  or  supporting  role.  A  multiple  objective 
decision  analysis  tool  was  developed  to  assess  the  effectiveness  of  these  engagement  activities.  Alternatives  are 
recommended  that  better  advance  USMARCENT  objectives. 

Beyond  Quarterback  Ratings:  Using  the  “ Whole  Team"  Approach  to  Hire  a  Championship  Team  for 
your  Organization 
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One  of  the  most  critical  tasks  any  organization  performs  on  a  regular  basis  is  the  hiring  of  new  personnel.  Certainly  this 
is  true  in  the  selection  and  “hiring”  of  faculty  members  at  the  United  States  Military  Academy  where  faculty  members  are 
expected  to  not  only  teach  and  do  research  but  more  importantly  to  coach,  mentor,  inspire  and  serve  as  role  models  for  their 
students/cadets  who  will  serve  as  future  Army  officers.  Previous  research  involved  identifying  the  qualities  most  important 
when  hiring  a  faculty  member  and  the  development  of  a  decision  support  tool  (DST)  to  assess  and  rank  potential  faculty 
members  to  assist  in  this  hiring  decision.  The  resulting  DST  allowed  the  decision-maker  to  quickly  identify  the  top  “overall” 
candidates.  This  begs  the  question,  however,  if  we  need  to  hire  five  new  employees  “Should  we  simply  hire  the  5  best 
candidates?”  Perhaps  our  organization  has  particular  needs  that  might  be  better  filled  with  some  combination  of  candidates 
other  than  the  top  five.  Consider  the  case  of  drafting  players  for  a  baseball  team.  A  strategy  of  selecting  the  9  best  athletes 
might  leave  you  in  dire  straits  if  there  isn’t  a  pitcher  among  the  top  9.  In  this  paper  we  will  build  on  the  previous  work, 
continuing  our  use  of  Multi-Objective  Decision  Analysis  and  incorporating  Optimization  and  Portfolio  Theory  to  develop  a 
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decision  support  tool  that  will  allow  the  selection  of  an  optimal  slate  of  candidates.  We  will  begin  by  addressing  the  process 
for  determining  what  “team”  qualities  are  most  important  when  hiring  a  slate  of  employees.  We  will  then  look  at  the 
identification  of  metrics  that  can  be  used  in  a  decision  support  tool  to  assess  and  rank  how  well  slates  of  potential  employees 
meet  these  qualities.  A  case  study,  involving  the  generation  and  application  of  such  a  decision  support  tool  to  assist  in  the 
selection  process  of  future  faculty  members  in  the  Department  of  Systems  Engineering  at  the  United  States  Military 
Academy  will  serve  as  the  backdrop  for  this  discussion. 

Objective  Force  Risk  Analysis 

Mr.  Steven  L.  Moniz 

US  Army  TRAC 

Future  Concepts  Directorate 

255  Sedgwick  Avenue,  Fort  Leavenworth,  KS  66027-2345 

Phone:  COMM:  (913)  684-9146,  Fax  -9189,  Email:  monizs@trac.armv.mil 

In  the  early  1990’s  the  Army  set  the  goal  of  applying  risk  management  principles  to  all  of  its  projects  and  processes. 
TRAC  has  begun  a  risk  management  analysis  of  the  Army’s  transition  to  the  future  Objective  Force.  This  analysis  supports 
the  development  of  Objective  Force  concepts  by  identifying  the  hazards  most  dangerous  to  future  operations  and  most 
relevant  to  the  transition  process. 

The  presentation  will  cover,  in  addition  to  the  results,  the  challenges  of  identifying  the  hazards,  collecting  the  data  (via  a 
survey),  and  analyzing  the  data. 

Survey  Results  on  Modeling  Objectives  on  Cost  in  a  Decision  Maker  ys  Value  Structure 
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COL  William  K.  Klimack  and  CPT  Frank  Snyder 
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Department  of  Systems  Engineering 
United  States  Military  Academy,  West  Point,  NY  10996 


Following  a  previous  paper  entitled  Modeling  Objectives  on  Cost  in  a  Decision  Maker's  Value  Structure ,  the  authors 
present  the  results  of  survey  research  conducted  to  determine  whether  or  not  the  objective  of  minimizing  cost  should  be 
included  as  part  of  the  fundamental  objectives  hierarchy  when  modeling  a  decision  maker's  value  structure.  Conclusions  are 
drawn  for  both  practitioners  and  academicians.  For  practitioners,  the  discussion  addresses  which  technique  those  who  know 
and  use  decision  analysis  prefer  and  why.  Suggestions  for  using  the  two  competing  techniques  both  separately  and  together 
are  offered.  For  academicians,  as  a  by-product  of  the  surveys,  survey  results  illuminate  how  much  and  what  kind  of  decision 
analysis  training  and  education  is  received  by  systems  engineers,  operations  researchers,  engineering  managers,  decision 
analysts  and  others.  Hypothesis  testing  using  the  Chi-Square  Test  with  Fixed  Marginal  Totals  is  used  to  validate  certain 
points. 

Determining  the  Homeland  Security  Force  Structure  Requirement 
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Beginning  in  the  spring  of  2000,  the  Army  undertook  efforts  to  change  the  paradigm  of  treating  Homeland  Security  as  a 
lesser-included  force  structure  requirement.  The  results  of  this  shift  led  to  the  development  of  the  Army  Strategic  Planning 
Guidance  (coordinating  draft,  September  10,  2001).  This  planning  guidance  serves  as  the  framework  for  determining  the 
Army’s  force  requirement  to  support  Homeland  Security.  There  are  seven  basic  mission  types  that  are  covered  in  the 
planning  guidance.  The  study  employs  three  techniques  to  determine  the  requisite  force  structure  for  each  mission  type.  This 
first  technique  involved  collecting  known  information  of  current  force  structure  that  had  a  Homeland  Security  role.  The 
second  used  a  forecasting  tool.  Stochastic  Analysis  of  Resources  for  Deployments  and  Excursions  (SARDE)  that  used 
historical  events  to  predict  the  average  monthly  force  requirement  for  certain  mission  types.  The  final  technique  involved 
basic  set  theory  to  estimate  the  requirement  based  on  several  possible  scenarios.  The  results  of  this  study  were  used  in  the 
Total  Army  Analysis  ’09  process  that  determines  the  desired  total  active  and  reserve  component  requirements  through  year 
2009.  These  results  also  give  a  defensible  force  structure  that  Army  planners  can  use  to  convey  its  requirements  to  the  Join 
Staff  and  sister  services.  Lastly,  the  study  demonstrates  how  the  Army  is  currently  supporting  the  National  Command 
Authority’s  efforts  to  ensure  the  safety  and  security  of  the  nation. 
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Developing  an  Investment  Decision  Analysis  approach  to  Ballistic  Missile  Defense  involves  the  evaluation  and 
comparative  analysis  of  elements  that  operate  together  under  varying  environments.  Elements  from  the  three  segments  of 
missile  defense,  boost,  mid-course,  and  terminal,  all  need  to  be  incorporated  into  the  desired  layered  defense  approach  and 
comprise  alternatives  that  differ  on  a  number  of  evaluation  criteria.  To  perform  analyses  across  this  layered  defense  requires 
the  development  of  a  set  of  benefit  criteria  that,  when  weighted  and  measured,  does  not  create  a  bias  in  any  direction.  Both 
qualitative  and  quantitative  date  may  be  applied  to  comprise  utility  functions.  Cost  factors  are  also  of  significance  with  the 
examination  of  sunk  costs,  extensive  research  and  development  dollars  and  incorporation  of  unknown  procurement,  and 
operations  and  support  costs.  An  approach  of  developing  a  common  set  of  benefits  and  measuring  utility,  then  applying 
decision  support  tools  based  on  multi-attribute  utility  theory,  has  been  utilized  to  develop  a  baseline.  This  baseline  is  being 
used  to  further  examine  utility  over  time  and  sensitivity  of  benefit  weighting  criteria  for  various  BMD  systems  in  this 
ongoing  investment  analysis. 


Allocating  the  Army  budget,  insights  into  understanding  and  realizing  a  decision  maker's  values  in  a 
complex  decision  environment 
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The  Army  uses  a  complex  process  involving  dozens  of  people  to  develop  the  Army  Program  in  the  PPBS.  Senior  leaders 
are  not  satisfied  with  their  ability  to  convey  their  programming  guidance  to  the  people  who  manage  the  process  even  though 
the  senior  leaders  ultimately  approve  the  results.  We  apply  decision  analysis  to  expose  the  underlying  nature  of  the  decisions 
that  must  be  made  and  propose  techniques  by  which  the  senior  leaders  can  be  sure  to  provide  their  programming  guidance  to 
the  Program  Element  Groups  that  generate  the  programming  options.  One  of  the  techniques  that  we  will  examine  in  detail  is 
a  tool  that  allows  senior  leaders  to  adjust  constraints  and  proportions  from  multiple  programming  perspectives. 


Risk-Based  Decision  Analysis  Applied  to  Combat  Terrorism 
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Terrorism  presents  an  asymmetric  threat  to  military  forces  and  assets  that  requires  an  understanding  of  potential  hazards 
and  the  effects  on  the  functions  of  military  systems.  To  stop  terrorist  threats,  effective  countermeasures  are  necessary  to 
deter,  detect,  defend,  and  mitigate  against  potential  threat  scenarios.  Decisions  for  the  implementation  of  countermeasures  in 
the  most  effective  and  cost  effective  manner  is  a  problem  that  can  be  solved  with  the  assistance  of  decision  theory  tools.  To 
help  prioritize  the  need  for  potential  countermeasures,  risk-based  decision-making  may  be  applied. 

Risk-based  decision  making  requires  the  use  of  risk  -based  technologies  that  consist  of  risk  assessment,  risk 
management,  and  risk  communication.  Risk  assessment  identifies  three  main  questions  (1)  What  can  go  wrong?  (2)  What  is 
the  likelihood?  and  (3)  What  is  the  consequence?  To  help  answer  these  questions,  risk  models  developed  from  proven 
technologies  such  as  event  tree  and  fault  tree  analysis  may  be  developed.  Risk  management  provides  tools  for  applying  the 
risk  assessment  results  for  decision  making.  Risk  communication  establishes  communications  tools  between  all  stakeholders 
in  the  decision  process  concerning  risk. 

The  proposed  risk-based  decision  process  is  being  applied  to  analyze  the  problem  of  terrorist  activity  for  SSBN  security. 
These  tools  are  intended  to  improve  the  decision  process  by  prioritizing  terrorist  risk  on  targets  functional  capabilities  and 
identifying  the  most  efficient  and  effective  countermeasure  techniques. 
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The  Thrift  Savings  Plan  (TSP)  is  a  retirement  savings  and  investment  program  designed  for  US  government  employees. 
It  is  similar  to  401k  plans  offered  by  many  civilian  companies  and  allows  participants  to  invest  pre-tax  dollars  to  reduce 
current  taxable  income  and  to  defer  the  taxes  of  investments  and  earnings  until  withdrawal.  The  TSP  recently  opened 
participation  to  members  of  the  uniformed  services.  Participants  can  invest  in  a  choice  of  five  funds,  each  with  a  historical 
risk/retum  profile.  To  date,  sources  available  to  educate  investors  in  the  TSP  (www.tsp.gov,  Army  Times  articles,  etc.)  have 
focused  on  descriptions  of  the  funds  and  administrative  aspects  of  participation.  This  paper  addresses  some  of  the  deeper 
questions  facing  investors  such  as  whether  to  participate  in  the  TSP,  factors  in  deciding  how  much  to  invest,  and  how  one 
might  optimally  allocate  money  into  the  five  funds  based  on  an  individual’s  risk  tolerance.  Questionnaires  and  other 
assessment  and  educational  tools  are  identified  that  can  aid  in  investor  decision-making.  For  example,  appropriate 
constraints  can  be  established  based  on  investor  desires  and  assets  currently  owned  and  mean-variance  quadratic  optimization 
can  be  used  to  help  the  TSP  participant  choose  an  allocation  strategy. 
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As  both  communications  bandwidth  increases  and  computing  capability  continues  to  become  more  sophisticated,  the 
ability  to  share  information  and  resource  states  across  platforms  in  real  time  becomes  more  realizable.  Thus,  the  potential  for 
a  complete  realization  of  the  vision  of  Network  Centric  Warfare  comes  closer  to  reality.  With  these  advances  and  the 
constantly  evolving,  more  dangerous  threats,  the  need  for  multi-platform  Distributed  Weapon  Control  (DWC)  becomes 
inevitable.  DWC  consists  of  three  components,  namely,  Threat  Assessment,  Sensor  Coordination  and  Engagement 
Coordination.  Engagement  Coordination  is  the  utilization  of  forces,  networked  information  and  resources  in  a  more  effective 
way  to  defeat  the  enemy  and  is  the  topic  of  interest  in  this  brief. 

The  High  Performance  Distributed  Computing  (HiPer-D)  laboratory  is  a  real-time  laboratory  located  in  Dahlgren 
Virginia  where  multiple  Aegis  tactical  system  platforms  are  prototyped  in  order  to  demonstrate  proofs  of  concepts  with 
respect  to  advanced  computing  architecture  and  algorithm  development.  There  it  was  shown  that  a  multi-objective  algorithm 
could  make  a  decision  in  a  tactical  environment  in  real-time  by  sharing  fire  control  information  across  Aegis  platforms.  The 
next  phase  was  to  show  value  added  to  the  battlegroup.  This  brief  describes  the  current  Engagement  Coordination  schemes 
in  the  Navy  Fleet  today.  It  then  demonstrates  through  modeling  how  using  shared  high  fidelity  fire  control  information, 
platform  state  information  across  platforms  and  a  multi-objective  decision  algorithm  can  improve  battlegroup  effectiveness. 
The  focus  of  this  brief  is  to  show  the  value  added  using  a  multi-objective  decision  algorithm  to  select  the  shooter  over  the 
current  Engagement  Coordination  schemes  used  in  the  Navy  fleet  today.  Additional  discussion  includes  how  this 
methodology  can  be  extended  to  other,  non-Aegis  platforms  due  to  the  generic  criteria  and  required  interfaces. 
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Joint  Virtual  Battlespace  (JVB)-A  Concept  Evaluation  Environment 

Dr.  Rob  Alexander 
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1 100  N.  Glebe  Road 
Arlington,  VA  22201 

(703)  907-2547,  ralexander@sito.saic.com 

‘The  Army  must  change.”  So  says  LtGen  John  Riggs,  Director  of  Objective  Force  Task  Force.  But  how  should  it 
change?  To  understand  how  best  to  transform  the  Army  to  fulfill  the  defense  needs  of  the  nation  in  the  21st  Century,  there  is 
a  requirement  for  detailed,  yet  broad  analysis  of  proposed  concepts.  Broad  analysis  must  be  done  to  insure  the  applicability 
of  concepts  and  developmental  systems  in  the  context  of  likely  and  plausible  future  military  scenarios.  Yet  the  analysis  must 
also  dive  deep  into  the  details  of  information  flow,  communications,  situational  awareness,  weapons  and  survivability,  and  at 
the  same  time  support  development  of  a  wide  family  of  new  systems  (Future  Combat  System)  and  others.  Stovepipe  analysis 
of  a  single  weapon  system,  using  a  set  of  standard  standalone  simulations,  will  not  meet  this  requirement.  Instead,  the  Army 
is  building  an  evaluation  environment  called  Joint  Virtual  Battlespace  (JVB)  using  the  SMART  (Simulation  &  Modeling  for 
Acquisition,  Requirements  and  Training)  process.  JVB  is  using  distributed  simulation  to  incorporate  the  best  existing  models 
and  simulations  as  needed  for  evaluation  of  specific  warfighting  and  weapon-system  concepts.  The  emphasis  in  JVB  is  on 
integrating  existing  tools,  not  building  new  components  unless  absolutely  necessary  to  bridge  gaps  between  legacy  models. 
The  environment  is  tailorable  to  analysis  needs  by  incorporating  various  tools  when  they  are  needed  to  answer  specific 
questions.  And  is  this  not  how  analysis  should  work?  First  formulate  the  question,  and  only  then  select  or  build  a  tool  to  help 
answer  it. 

An  initial  study  in  support  of  Program  Manager  Aerial  Common  Sensor  (ACS)  is  in  the  final  stages.  This  ACS  study 
provided  a  proof-of-concept  for  the  JVB  approach,  and  serves  as  the  foundation  for  the  JVB  Federation  Object  Model  and 
suite  of  models  and  simulations.  The  current  focus  of  JVB  is  to  support  Objective  Force  analysis  for  TRADOC  Analysis 
Center.  For  this  effort,  JVB  is  gathering  a  variety  of  models  and  simulations  from  STRICOM,  Department  of  Energy’s 
Sandia  National  Laboratory,  the  Army  Research  and  Development  Engineering  Center,  and  other  agencies  and  contractors. 
In  the  coming  years,  JVB  will  provide  a  robust,  tailorable,  and  focused  tool  set  to  answer  the  question  ‘‘How  should  the  Army 
change?” 

Pythagoras:  The  Newest  Member  of  the  Project  Albert  Family 

Edmund  Bitinas 
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Pythagoras  is  a  new  Agent-based  distillation,  being  developed  to  supplement/complement  the  Project  Albert  family  of 
distillations,  which  include  Mana,  Socrates  and  Isaac.  Pythagoras  brings  new  capabilities  to  this  family,  such  as  Soft 
Decision  Rules,  Dynamic  Sidedness,  Behavior-Change  Triggers  and  Non-Lethal  Weapons.  Soft  Decision  Rules  create 
instances  of  Agents  from  the  same  Agent  class  that  have  behaviors  that  are  unique  from  one  another.  Dynamic  Sidedness 
allows  Agents  to  change  sides  as  a  function  of  actions  and  events  that  they  encounter.  Behavior-Change  Triggers  allow 
Agents  to  change  their  behavior  as  a  function  of  actions  or  events.  Non-Lethal  Weapons,  not  only  cause  suppression,  but 
may  also  change  the  sidedness  or  affiliation  of  an  Agent.  Pythagoras  Scenarios  include  a  Cave  Search  scenario  in  which 
Marines  look  for  an  elusive  Agent.  A  Peace  Keeping  Scenario  has  also  been  built  in  which  Marines  use  short-range  non- 
lethal  weapons  (like  leaflets  or  food)  to  sway  the  affiliation  of  villagers,  while  an  enemy  is  broadcasting  propaganda  with  an 
indirect  fire  non-lethal  weapon  (a  bull  horn)  to  sway  them  against  the  Marines.  Pythagoras  is  written  in  JAVA,  and  is  hosted 
at  the  Maui  High  Performance  Computing  Center,  where  it  is  available  for  data  farming  -  executing  large  numbers  of 
repetitions  of  parametric  runs  to  identify  areas  of  unexpected  behaviors  and  non-linear  results  in  a  co-evolving  landscape. 
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The  effectiveness  of  a  commander's  execution  of  a  course  of  action  (COA)  is  certainly  dependent  on  the  adaptive  control 
exercised  over  his  or  her  forces,  which  in  turn  depends  on  the  information  available  about  those  forces,  the  enemy  forces,  and 
general  notions  of  the  battle  flow.  We  discuss  an  ongoing  investigation  of  battlefield  metrics  intended  to  enhance  the 
information  supporting  the  commander's  decisions,  especially  as  to  specific  events,  conditions,  or  interactions  that  may 
probabilistically  foretell  the  battle  outcome.  A  small  Southwest  Asia  scenario  is  simulated  repeatedly  in  One  Semi- 
Automated  Forces  (OneSAF).  Standard  outputs  from  OneSAF  in  addition  to  outputs  from  a  new  Killer/Victim  Scoreboard 
utility  developed  at  the  Army  Research  Laboratory  are  used  to  support  data  mining  of  the  battles.  We  envision  that  such  an 
approach,  given  a  believable  and  rapid  simulation  capability,  could  provide  the  commander  insight  to  new  and  intricate 
battlefield  parameters,  thereby  signaling  at  various  stages  of  the  battle  to  continue  with  the  COA,  adapt  to  an  alternative  plan, 
or  break  off  the  mission.  We  will  share  an  example  of  insights  to  this  specific  scenario. 
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This  presentation  describes  a  method  of  creating  a  robust  competitive  context,  “Co-Revolutionary  War  Gaming.”  Using 
Co-Revolutionary  War  Gaming,  players  can  quickly  and  inexpensively  explore  an  extremely  vast  landscape  of  possibilities 
from  many  perspectives.  This  method  re-introduces  the  classic  premises  behind  scenario-based  planning  that  the  gaming 
community  has  abandoned  in  favor  of  automated  analyses  and  closely  scripted  games.  In  addition  to  the  classic  elements  of 
gaming,  Co-Revolutionary  War  Gaming  also  employs  a  “landscape  search”  strategy  similar  to  that  examined  in  recent 
research  into  evolutionary  biology.  Recent  results  from  a  long-term  investment  strategy  Co-Revolutionary  War  Game  will  be 
presented. 
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The  goal  of  military  education  is  to  help  soldiers  understand  the  nature  of  war  and  to  teach  them  how  to  think  logically 
and  creatively  about  war  and  during  war.  Every  great  military  leader  understood  that  success  in  battle  is  attributed  to  well- 
trained  forces.  We  intend  to  show  that  wargaming  can  play  a  major  role  in  the  course  of  instructing  maneuver  warfare 
techniques.  Modeling  and  Simulation  has  a  pivotal  role  to  play  in  providing  trainers  with  sound  analytical  support  on 
training  activities  designed  to  teach  maneuver  warfare.  Our  study  employed  Systems  Effectiveness  Analysis  Simulation 
(SEAS),  an  AF  Toolkit  campaign  level  model.  In  the  past  SEAS  has  been  used  by  senior  AF  decision  makers  to  determine 
future  space  systems  policy.  Future  uses  could  be  to  provide  analytical  support  to  scenario  construction  and  evaluation  of  the 
learning  process,  for  individual  or  collective  training.  Our  research  applies  the  maneuver  warfare  principles  from  the 
Maneuver  Warfare  Handbook  at  the  company  level  and  below.  It  can  be  used  to  teach  students  to  make  educated  decisions 
through  a  coherent,  logical  thought  process.  Advanced  techniques  such  as  unit  skills,  conducting  a  specific  type  of  attack, 
and  employing  combined  arms  can  be  taught  and  demonstrated.  The  SEAS  model  was  developed  in  such  a  way  that  it  allows 
for  “tactical  programming”,  which  permits  the  application  of  maneuver  warfare  techniques.  Most  computerized  games  try  to 
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decide  “who  won”  by  rewarding  “kills”.  SEAS,  however,  is  designed  to  give  the  decision  maker  or  instructor  or  student 
insight  into  the  effects  of  variables.  There  is  no  right  answer  in  maneuver  warfare,  only  timely  and  logical  ones. 


Objective  Force  Concept  Exploration,  A  Notional  Combat  Battalion  Engagement 

Major  Paul  Finken 

TRADOC  Analysis  Center,  ATRC  -  FF 
Ft.  Leavenworth,  KS  66027 
(913)  684-9169;  FAX  (913)  684-9189 
fmkenp@trac.armv.mil 

This  study  supports  Objective  Force  Combat  Battalion  concept  development  and  the  Army  Transformation.  It  focused 
on  developing,  examining,  and  refining  Combat  Battalion  concepts,  and  supporting  the  Future  Combat  System  (FCS) 
Mission  Needs  Analysis. 

The  study  scenario  facilitates  analysis  of  the  Objective  Force  in  combat  operations.  The  scenario  provides  a  context  in 
which  an  Objective  Force  Combat  Battalion  conducts  offensive  operations  in  2015  against  a  technologically  advanced  Red 
force.  The  engagement  was  explicitly  modeled  using  the  Interactive  Distributed  Engineering  Evaluation  and  Analysis 
Simulation  (IDEE AS)  model.  IDEEAS  is  an  entity-based  simulation,  capable  of  force-on-force  representations,  that  permits 
examination  of  concepts  and  parametric  analysis  at  the  engineering  level  of  detail.  Use  of  the  notional  battalion  force 
structure  allowed  O&O  concept  exploration  prior  to  force  design  decisions. 

This  study  contributed  substantially  to  the  development  of  the  Objective  Force,  especially  with  regard  to  the  Unit  of 
Action  force  design.  In  addition  to  the  development  of  concepts,  tactics,  and  insights  for  future  operations  the  study  provided 
a  powerful  visualization  of  this  future  force.  The  scenario  and  base  case  developed  during  this  study  were  used  extensively 
by  the  TRADOC  Unit  of  Action  Task  Force  in  their  subsequent  refinement  of  the  force  design.  These  tools  were  also  used 
by  the  Army  Medical  Department  in  its  transformation  wargame  effort. 

This  presentation  will  provide  an  overview  of  the  study  scenario’s  purpose,  methodology  and  results. 


Combining  Live  and  Virtual  Simulations  to  Operationally  Test  Electronic  Countermeasures  Against 
Modern  Surf ace-to- Air  Missile  Systems 


Dr  Frank  Gray 

Deputy  Technical  Director 

Air  Force  Operational  Test  and  Evaluation  Center 

HQ  AFOTEC/CAD 

8500  Gibson  Blvd  SE 

Kirtland  AFB,  NM  87117-5558 

(505)  846-9828;  FAX  (505)-846-9726 

Frank.Grav@afotec.af.mil 


Mr  Jeff  Cheney 
Deputy  Director 

Air  Force  Electronic  Warfare  Evaluation  Simulator 

412TW/OL-AB 

Box  371  MZ1 100,  AF  Plant  4 

Ft.  Worth,  TX  76101 

(817)  763-4783;  FAX  (817)  777-4911 

ichenev@dcmdw.dcma.mil 


Captain  Jimmy  H.  Hammonds 
Project  Engineer 

Air  Force  Electronic  Warfare  Evaluation  Simulator 

412TW/OL-AB 

Box  371  MZ1 100,  AF  Plant  4 

Ft.  Worth,  TX  76101 

(817)  763-4469;  FAX  (817)  777-4911 

ihammonds@dcmdw.dcma.mil 

This  presentation  describes  preliminary  results  from  a  FY  2002  project  funded  by  the  Threat  Systems  Integration 
Working  Group.  We  explain  the  design  and  analysis  of  a  series  of  experiments  conducted  in  the  Air  Force  Electronic 
Warfare  Evaluation  Simulator  facility.  These  experiments  were  designed  to  identify  important  and  unimportant  hardware-in- 
the-loop  modeling  considerations.  The  specific  application  is  operationally  testing  electronic  countermeasure  systems  that 
attack  modern  surface-to-air  missile  systems  using  seeker-aided  ground  guidance  schemes.  These  missile  systems  use  a 
hybrid  guidance  that  combines  target  tracking  radar  and  semi-active  seeker  inputs  within  the  tracking  loop.  The  tracking 
loop  is  closed  on  the  ground  and  guidance  commands  are  sent  to  the  missile.  Because  both  sources  can  be  used  in  a  guidance 
solution,  the  effect  of  a  countermeasure  is  difficult  to  observe  without  actually  shooting  a  missile.  Some  alternatives  to  live 
shots  include  ground-mounted  seeker  tests  or  tests  using  a  seeker  flown  on  a  test  bed  aircraft.  But,  aside  from  other 
difficulties,  these  solutions  significantly  limit  the  ability  to  fly  operationally  realistic  test  scenarios.  An  option  that  does  not 
restrict  open-air  range  scenarios,  and  the  one  considered  here,  is  to  fly  against  a  target  tracking  radar  in  a  live  simulation, 
record  the  results,  and  then  use  those  results  in  a  virtual  hardware-in-the-loop  simulation  that  adds  a  missile  seeker.  The 
experimental  strategy  starts  with  an  initial  screening  experiment  to  sift  through  a  set  of  candidate  factors  and  identify  those 
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that  could  have  significant  impacts  on  selected  responses.  Follow-on  experiments  resolve  confounding,  estimate  the  nature 
of  important  main  effects,  and  identify  important  interactions.  The  goal  is  to  produce  a  set  of  guidelines  for  operational 
testers  to  use  when  planning,  conducting,  and  evaluating  combined  tests. 

Analyzing  Anti-Terrorist  Force-Protection  Tactical  Effectiveness  using  X3D  Graphics  and  Agent 
Based  Simulation 


Lieutenant  James  Harney 

Naval  Postgraduate  School,  Code  32 
589  Dyer  Road  Rm200A 
Monterey,  California  93943 
(831)  656-2094;  FAX  (831)  656-3681 
iwhamev@nps.navy.mil 

John  Hiles 

Naval  Postgraduate  School,  Code  32 

589  Dyer  Road  Rm200A,  Monterey,  California  93943 

831-656-2988;  FAX  831-372-1949 

ihiles@mindspring.com 


Curtis  L.  Blais 

Naval  Postgraduate  School,  Code  32 
589  Dyer  Road  Rm200A 
Monterey,  California  93943 
831-656-2488;  FAX  831-656-3679 
clblais@nps.navv.mil 

Dr.  Don  Brutzman 
Code  UW/Br 

Naval  Postgraduate  School,  Monterey,  California  93943 
(831)  656-2149;  FAX  (831)  656-3679 
brutzman@nps.navy.mil 


U.S  Naval  Forces  are  increasingly  the  target  of  terrorist  attack.  There  is  a  strong  need  to  provide  emerging  technologies 
to  forces  afloat  for  analysis  and  visualization  of  tactical  posture  when  defending  warships  in  port.  The  SAVAGE  research 
group  at  the  Naval  Postgraduate  School  (NPS)  is  building  a  large  public-domain  library  of  models  and  prototyping  tools.  We 
construct  tactically  interesting  virtual  environments  using  Extensible  3D  (X3D)  graphics,  providing  interactive  displays  either 
in  standalone  mode  or  via  the  Web.  A  sophisticated  series  of  interactive  Web-based  3D  scenarios  utilize  georeferenced 
terrain,  humanoid  avatars,  physically  based  models  and  networked  agent-based  simulation.  For  example,  a  sophisticated 
scenario  for  U.S.  Marine  amphibious  assault  shows  key  spatial  relationships  that  can  easily  be  overlooked  if  solely  analyzing 
in  a  2D  context. 

This  presentation  shows  technical  results  representing  conflicts  between  friendly  and  hostile  assets,  simulating  complex 
ship-level  Anti-terrorism  and  Force  Protection  (ATFP)  measures.  Specifically,  we’ve  built  an  agent-capable  3D 
reconstruction  of  the  small-boat  terrorist  attack  carried  out  by  A1  Qaeda  on  the  USS  COLE  in  October  2000  at  Aden  Harbor 
Yemen.  These  integrated  models  enable  simulation,  experimentation,  visualization  and  statistical  assessment  for  discovering 
potential  shortcomings  in  force  protection.  A  software-agent  architecture  capturing  varied  friendly  and  hostile 
representations  is  used  to  explore  basic  interactions,  unforeseen  threat  combinations  and  even  sensitivity  analysis  regarding 
skills,  training  and  personality  traits  of  defending  personnel. 

New  applications  of  statistical  analysis  are  possible  using  this  methodology.  Typically,  outputs  of  interest  include 
sequential-statistic  means  and  standard  deviations  for  various  tactical  measures  of  effectiveness  (MOEs).  For  self-defense 
preparations,  however,  outlier  scenarios  that  reveal  unexpected  tactical  vulnerability  provide  new  and  critically  important 
analytic  outputs.  The  ability  to  plan,  replay,  analyze  and  replan  realistic  scenarios  makes  this  approach  valuable  for  both 
training  and  self-defense.  In  closing,  we  examine  next  steps  for  scaling  models,  simulations  and  statistics  to  battle  group  and 
theatre-level  scenarios  of  tactical  interest. 


Wargaming  to  Support  Objective  Force  Concept  Development 

Rochelle  A.  Hill 

TRADOC  Analysis  Center,  ATRC  -  FF 
255  Sedgwick  Ave,  Fort  Leavenworth,  KS  66027 
(913)  684-9320;  FAX  (913)  684-9189 
hillr@trac.armv.mil 


The  Objective  Force  is  the  realization  of  the  Army  vision  that  was  presented  by  the  Chief  of  Staff  of  the  Army  (CSA)  in 
October  1999.  The  transformation  from  vision  to  fielded  Objective  Force  is  a  process  that  will  occur  over  several  decades. 
An  early  and  critically  important  piece  of  this  process  is  the  development  of  Operational  and  Organizational  (O&O) 
Concepts.  These  Objective  Force  O&O  concepts  are  grounded  in  the  futures  work  that  was  done  as  part  of  the  Army  After 
Next  (AAN)  project.  Futures  wargaming  has  evolved  to  become  an  important  part  in  the  development  of  these  concepts.  In 
particular,  the  annual  Army  Transformation  Wargame  (ATWG)  has  emerged  as  the  Army’s  most  visible  event  for  future 
concept  development. 

The  TRADOC  Analysis  Center  (TRAC)  serves  as  the  lead  analytic  agency  for  the  ATWG  sponsored  by  the  TRADOC 
Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  This  series  of  wargames  is  designed  to  describe,  refine  and  evaluate 
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Objective  Force  concepts  and  capabilities  over  a  multi-year  period.  These  wargames  provide  the  Army  an  opportunity  to 
explore  future  Army  operations  at  the  strategic  and  operational  levels  of  war  in  a  political/military  wargame  environment. 

This  presentation  will  address  the  analytic  support  provided  to  ATWG  01,  Vigilant  Warriors.  In  particular,  it  will 
provide  an  overview  of  the  wargame  to  include  analysis  and  reporting  of  the  insights  for  the  issues  addressed. 

Art  Integrated  Gaming  System  for  the  Army  Transformation  Wargame 
Eric  Johnson 

TRADOC  Analysis  Center,  ATRC  -  FF 

255  Sedgwick  Ave 

Fort  Leavenworth,  KS  66027 

(913)  684-9287;  FAX  (913)  684-9189 

iohnsone@trac.army.mil 

The  Integrated  Gaming  System  (IGS)  is  an  integrated,  model-supported  gaming  system  consisting  of  a  set  of  tools  linked 
to  a  common  database  and  capable  of  supporting  a  wide  range  of  gaming  requirements.  The  U.S.  Army  Training  and 
Doctrine  Command  (TRADOC)  Analysis  Center  (TRAC)  provides  contract  oversight  management  for  the  development  and 
use  of  the  IGS  in  support  of  the  TRADOC  Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  The  Wargaming  and  Futures 
Directorates  within  DCSDOC  are  the  program  and  systems’  sponsors. 

The  IGS  is  a  Booz-Allen  &  Hamilton  (BAH)-developed  wargame  automation  system  that  fulfills  the  functional 
requirements  of  the  Wargame  Architecture  (WGA)  concept,  which  developed  out  of  requirements  identified  by  DCSDOC 
beginning  in  1996.  DCSDOC  identified  these  requirements  while  preparing  for  a  series  of  wargaming  events  that  supported 
the  Army  After  Next  (A AN)  future  studies  effort.  The  purpose  of  the  IGS  is  to  perform  the  functions  of  the  WGA  in  support 
of  TRADOC’s  Army  Transformation  wargame,  study,  and  research  efforts.  This  presentation  provides  an  overview  of  the 
IGS  system,  its  components,  and  its  use  during  last  year's  Army  Transformation  Wargame  -  Vigilant  Warriors  01. 

An  Application  of  Distillation  Modeling  to  Studying  the  Enemy  Within 

Sarah  K.  Johnson 

The  MITRE  Corp. 

2750  Kilarney  Drive,  Suite  100 
Woodbridge,  VA  22192 
(703)  580-0077;  FAX  (703)  580-0597 
iohnsone@trac.armv.mil 

Ongoing  research  into  how  to  develop  better  maneuver  warriors  through  application  of  distillation  modeling  and  data 
farming  to  questions  regarding  conflict  is  sponsored  by  the  USMC’s  Project  Albert.  MITRE  is  supporting  Project  Albert’s 
effort  to  develop  tools  to  explore  questions  using  a  synthesis  of  both  new  and  existing  models.  The  approach  is  to  use  a 
series  of  new  models/analytic  tools,  multi-disciplinary  teams,  and  the  scientific  method  to  explore  questions,  exploit  advances 
in  computing  power  and  visualization  tools,  and  utilize  the  meta-technique  of  “Data  Farming’’  to  go  beyond  single  point 
estimate  and  look  at  questions  from  the  perspective  of  many  data  points.  This  presentation  describes  a  set  of  recent 
applications  addressing  questions  relating  to  “the  threat  within’’  including  martyr-minded  enemies,  sabotage  and  corruption, 
incompetence,  and  false  intelligence.  A  demonstration  of  the  distillation  tools  employed  in  this  research  as  well  as  data 
associated  with  this  study  will  be  discussed. 


Integrated  Communications  Replication  in  CASTFOREM 


David  P.  Kellev 

TRADOC  Analysis  Center 

ATRC-WAB 

WSMR,  NM  88002 

(505)  678-8025;  (505)  678-4314 

kellevd@trac.wsmr.armv.mil 


Major  Alvin  F.  Crowder 
TRADOC  Analysis  Center 
Monterey,  CA  93943 
(831)  656-4061;  (831)  656-3086 
crowdera@trac.nps.navv.mil 


Objective  Force  and  FCS  are  expected  to  rely  heavily  on  integrated,  seamless  communications  and  situational  awareness. 
Potential  operating  environments,  including  urban  and  other  complex  terrain,  and  geographical  separation  of  entities  within 
an  operations  area,  both  of  which  may  affect  communications,  are  factors  to  consider  during  the  design  of  equipment, 
organizations,  and  doctrine. 

High-resolution  combat  models  do  not  typically  play  explicit  communications  at  the  entity  level.  Engineering-level 
models  that  could  model  communications  do  not  typically  replicate  the  interactions  during  combat  operations,  including 
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attrition,  battle  damage,  and  logistics.  CASTFOREM  currently  has  a  fairly  robust  communications  architecture  portrayal, 
but  it  falls  short  in  its  ability  to  model  the  system  of  systems  communications  constructs  of  the  proposed  Objective  Force. 

This  presentation  discusses  ongoing  studies  in  further  advancing  the  simulation  capabilities  of  CASTFOREM, 
developing  new  descriptive  algorithms  for  embedding  communications  within  a  high-resolution  combat  model,  and  detailing 
the  shortcomings  that  even  a  perfect  replication  might  possess.  The  presentation  will  also  highlight  some  vignettes  used  to 
test  the  application  as  well  as  emerging  results. 

An  Agent-Based  Modeling  Approach  to  Measuring  the  Value  of  a  Proposed  Information  System 

Major  Robert  H.  Kewlev 

US  Army  Command  and  General  Staff  College 

US  Student  Division 

Fort  Leavenworth,  KS  66027 

(913)  680-0050;  FAX  (913)  684-2049 

robert .  kewlev  @  us .  army  .mil 

For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness 
of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  the 
extent  to  which  these  systems  increase  combat  effectiveness.  This  paper  describes  a  methodology  we  chose  to  investigate 
whether  an  agent-based-model  (ABM)  could  be  used  to  suggest  appropriate  behaviors  for  a  combat  force  equipped  with  a 
proposed  information  system  such  as  Future  Battle  Command  Brigade  and  Below  -  FBCB2.  The  decision  agents  within  the 
model  will  use  the  information  about  enemy  forces,  friendly  forces,  and  terrain  provided  by  the  proposed  information  system 
to  adjust  the  friendly  course  of  action  to  the  updated  situation.  Our  methodology  is  a  three-step  process.  We  first  execute 
simulation  runs  using  an  existing  dynamic  study  scenario  and  evaluate  the  results  of  these  runs.  In  the  second  step,  we 
transfer  the  terrain,  units,  and  course  of  action  from  the  existing  dynamic  scenario  to  an  ABM  with  intelligent  agents  that  will 
refine  the  course  of  action  genetic  algorithm  by  generating  new  unit  positions  and  routes  based  upon  the  current  situation.  In 
the  final  step,  we  substitute  the  ABM  developed  course  of  action  and  behaviors  back  into  the  dynamic  study  scenario  and 
execute  another  set  of  simulation  runs.  The  performance  of  the  friendly  force  using  the  proposed  information  system  and 
ABM  generated  behaviors  may  be  compared  to  the  performance  of  the  friendly  force  which  failed  to  take  advantage  of 
current  information.  This  gives  insight  into  the  potential  increase  in  combat  effectiveness  realized  through  the  use  of  an 
information  system. 


Modeling  and  Wargaming  of  Future  Combat  Systems  at  TRAC-WSMR 


Captain  Michael  Kirkland 

TRADOC  Analysis  Center 
ATRC  -  WJ,  WSMR,  NM  88002 
(505)  678-7869;  FAX  (505)  678-4866 
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TRADOC  Analysis  Center 
ATRC  -  WJ,  WSMR,  NM  88002 
(505)  678-1950;  FAX  (505)  678-4866 
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Simulation  Based  Acquisition  for  future  weapons  systems  entails  a  cradle  to  grave  program  in  which  modeling  and 
simulation  is  used  in  the  earliest  stages  of  weapons  systems  development  throughout  engineering  and  manufacturing,  test  and 
evaluation,  and  ending  with  a  simulation  that  soldiers  use  for  training. 

TRADOC  Analysis  Center-WSMR  was  truly  on  the  cutting  edge  of  the  earliest  stages  of  concept  exploration  of  the 
Future  Combat  Systems  acquisition  program.  The  Defense  Advanced  Research  Projects  Agency  (DARPA)  and  the  U.S. 
Army  selected  four  contractor  teams  for  the  Concept  Exploration  and  Design  phase  of  the  Future  Combat  Systems  (FCS) 
program.  The  Government’s  intent  for  the  four  contracting  teams  was  to  develop  a  virtual  FCS  using  the  Army’s  Simulation 
and  Modeling  for  Acquisition,  Requirements  and  Training  (SMART)  concept.  The  original  intent  included  competition 
among  the  teams  for  the  best  ideas  and  concepts  for  the  FCS  system.  The  four  teams  alternated  visits  to  TRAC-WSMR 
working  with  model  programmers  to  ensure  their  concepts  were  modeled  as  close  as  possible  to  ensure  the  most  realistic 
simulations  of  their  concepts.  From  October  2000  through  September  2001  the  contractors  and  TRAC  personnel  developed, 
refined,  and  analyzed  the  concepts. 

The  modeling  and  simulation  efforts  truly  reflected  the  intent  of  the  of  Army’s  acquisition  strategy  to  use  SBA  at  the 
earliest  stages  of  acquisition  programs.  The  results  of  the  many  runs  reflected  in  changes  in  the  contractor’s  force 
compositions,  doctrine,  TTPs,  weapons  choices,  sensor  package  choices,  etc 
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EINSTein  Model  Validation 

Captain  Randall  Klingaman  Colonel  William  B.  Carlton,  Professor 

Department  of  Systems  Engineering  Department  of  Systems  Engineering 

United  States  Military  Academy,  West  Point,  NY  10966  United  States  Military  Academy 
(845)  938-4753,  Randall . Kilingaman @ usma.edu  West  Point,  NY  10966 

The  use  of  Agent  Based  Models  (ABM)  to  simulate  behaviors  in  combat  is  gaining  increasing  recognition  and  interest 
across  the  Operations  Research  community  of  both  the  Marine  Corps  and  now  the  Army.  This  paper  presents  our  attempt  to 
“validate”  EINSTein  (Enhanced  ISAAC  Neural  Simulation  Tool)  by  comparing  its  outputs  to  those  of  another  well-known 
combat  simulation  model,  JANUS.  The  experiment  first  establishes  the  combat  effectiveness  of  EINSTein  entities  executing 
a  National  Training  Center  (NTC)-type  scenario.  The  scenario  is  designed  to  replicate  one  armored  company  of  14 
“friendly”  tanks  versus  a  similar  size  force  of  14  “enemy”  main  battle  tanks.  We  allowed  one  set  of  “friendly”  entities  to  gain 
knowledge,  or  “learn,”  by  using  the  genetic  algorithm  incorporated  in  EINSTein.  Another  set  of  friendly  entities  was  not 
allowed  to  “learn.”  For  both  cases,  we  recorded  both  the  combat  results  of  the  EINSTein  simulations  and  the  entity  actions. 
These  observed  actions  were  programmed  into  JANUS.  For  each  instance,  we  compared  the  combat  effectiveness  resulting 
from  JANUS  to  those  obtained  from  EINSTein.  The  hypothesis  of  the  experiment  is  that  the  entities  that  were  allowed  to 
“learn”  will  have  noticeably  different  behavior  and  have  a  significantly  better  loss-exchange  ratio  in  both  EINSTein  and 
JANUS.  The  paper  presents  the  findings  of  our  analysis  and  suggests  further  research  areas  for  using  ABM’s. 


Measuring  the  Difference  in  Force  Effectiveness  Resulting  From  Changes  in  Information  Systems 


Major  Larry  Larimer 

TRADOC  Analysis  Center 

ATTN:  ATRC-WBC 

White  Sand  Missile  Range,  NM  88002 

(505)  678-2914;  FAX  (505)  678-8074 

larimerlr@trac.wsmr.armv.mil 


Kelaine  M.  Nick 

TRADOC  Analysis  Center 

ATTN:  ATRC-WBC 

White  Sands  Missile  Range,  NM  88002 

(505)  678-5966;  (505)  678-8074 

nickkm@trac.wsmr.armv.mil 


For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness 
of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  how 
well  proposed  information  systems  perform. 

This  paper  describes  a  methodology  we  chose  to  assess  the  value  of  an  information  system  (Force  XXI  Battle  Command, 
Brigade  and  Below  -  FBCB2)  to  the  battlefield  decision  maker.  Our  approach  focuses  on  use  of  the  CASTFOREM  combat 
model  with  emphasis  on  tying  decisions  and  activities  to  available  information.  We  discuss  use  of  a  detailed  communications 
modeling/information  flow  capability  in  CASTFOREM,  situational  awareness  databases  at  the  platform  level,  decision¬ 
making  logic,  and  the  incorporation  of  enhanced  Combat  Service  Support  modeling  driven  by  communications  and  self- 
determined  movement  routes. 


Coevolving  Red  and  Blue:  The  Dynamics  of  Competition 


Mary  McDonald 

SAIC 

1 100  N.  Glebe  Road 
Arlington,  VA  22201 
(703)  784-6076;  FAX  (703)  784-3547 
mcdonaldml  @mccdc.  usmc.mil 


Steve  Upton 

The  MITRE  Corporation 
2907  W.  Bay  to  Bay  Blvd,  Ste  303 
Tampa,  FL  33829 

(813)  831-5535;  FAX  (813)  831-4661 
upton@mitre.org 


Typically,  operations  research  analysis  of  a  simulation  scenario  involves  perturbing  an  agreed-upon  base  case,  in  order  to 
perform  a  sensitivity  analysis  of  a  measure(s)  of  effectiveness  to  selected  inputs  to  the  simulation  being  run.  During  this 
process,  the  opposing  side’s  inputs  are  usually  held  constant.  Although  this  process  can  yield  interesting  insight  into  the 
scenario  at  hand,  it  lacks  the  ability  to  analyze  what  can  happen  if  red  and  blue  inputs  are  changed  in  direct  response  to  each 
other,  e.g.  as  a  result  of  direct  competition  to  each  other.  We  present  the  idea  of  coevolution  as  it  pertains  to  evolving  red  and 
blue  force  parameters  in  direct  response  to  each  other,  allowing  the  simulation  of  a  type  of  competitive  “arms  race”. 

A  brief  summary  of  evolutionary  computation  and  theoretical  underpinnings  of  coevolution  will  be  given.  Our 
implemented  evolutionary  computational  software  will  also  be  discussed,  and  preliminary  data  obtained  by  coevolving  red 
and  blue  on  one  of  the  Marine  Corps  Combat  Development  Command’s  simulations  will  be  presented  and  analyzed,  with  a 
focus  on  highlighting  key  research  questions. 
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Active  Protection  Methodology  Enhancements  to  CASTFOREM 

Peter  Norman 

USAMSAA,  AMXST-CS 

392  Hopkins  Road,  APG,  MD  21005-5071 

(410)  278-0695;  FAX  (410)  278-6585,  pnorman@amsaa.armv.mil 

There  has  been  heightened  interest  in  active  protection,  an  effort  to  avoid  being  hit  by  an  enemy  round,  since  the  advent 
of  the  Future  Combat  System.  Active  Protection  Systems  (APS)  include:  warning  receivers  that  detect  engagements  (missile, 
laser);  soft-kill  countermeasures  the  attempt  to  spoof  or  confuse  the  threat;  and  hard-kill  countermeasures  that  attempt  to 
destroy  the  incoming  round.  Much  of  CASTFOREM’s  current  active  protection  methodology  is  represented  as  a  single  user- 
defined  probability.  AMSAA  is  adding  quantitative  algorithms  to  CASTFOREM  to  represent  APS  in  a  more  realistic 
manner.  The  new  algorithms  dynamically  calculate  APS  effectiveness  based  on  engagement  and  APS  performance 
characteristics.  AMSAA  will  conduct  an  analysis  of  the  impact  of  these  changes  on  the  model,  both  with  respect  to  the 
performance  of  the  active  protection  technologies  as  well  as  the  performance  of  CASTFOREM  itself,  and  make 
recommendations  about  the  use  of  new  algorithms  in  CASTFOREM  baseline  and  COMBAT  XXI. 


Wargame  2000  Anchoring  Study 


Wayne  Pavalko 

JHU/APL 

1 1 100  John  Hopkins  Road,  Laurel,  MD  20723 
(240)  228-7464,  wavne.pavalko@ihuapl.edu 


Barry  Mitchell 
JHU/APL 

11100  John  Hopkins  Road 
Laurel,  MD  20723 


Michael  Monius 
JHU/APL 

11100  John  Hopkins  Road 
Laurel,  MD  20723 


The  authors  recently  conducted  a  model  anchoring  study  to  help  gain  confidence  in  the  Theater  Ballistic  Missile  Defense 
(TBMD)  representations  in  Wargame  2000,  a  state-of-the-art  command  and  control  simulation  under  development  at  the 
Joint  National  Integration  Center  (JNIC)  in  Colorado  Springs,  Colorado.  Wargame  2000  is  the  premier  human-in-the-loop 
test  bed  used  by  the  Missile  Defense  Agency  (MDA)  to  develop  operational  concepts  and  tactics,  techniques,  and  procedures 
for  missile  defense.  Key  TBMD  kill  chain  events  in  Wargame  2000  were  compared  against  kill  chain  timeline  predictions 
from  the  Extended  Air  Defense  Simulation  (EADSIM),  another  model  of  air  and  missile  defense,  using  system 
representations  approved  by  the  Army  and  Navy  Program  Offices  responsible  for  developing  TBMD  weapon  systems.  This 
paper  provides  background  information  on  Wargame  2000  and  the  anchoring  study,  discusses  how  the  study  team  overcame 
difficulties  that  inevitably  arise  when  trying  to  compare  two  models  having  different  underlying  assumptions,  and  presents 
the  final  results  of  the  exercise.  The  Wargame  2000  anchoring  study  is  a  success  story  in  model  validation  and  MDA  is 
currently  considering  expansion  of  the  anchoring  program  to  help  gain  confidence  in  the  entire  family  of  MDA  mission-level 
models  of  missile  defense. 


Information  Modeling  of  Future  Technology:  Using  Complex  Adaptive  Systems  to  Model  Warfare  in 
the  21st  Century 

Major  David  Sanders 

Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10966 
(845)  938-5539,  fd0357@usma.edu 

We  describe  the  modeling  of  warfare  as  a  complex  adaptive  system  with  emphasis  on  the  use  of  information  in  combat. 
Specifically,  we  address  the  ability  of  Agent-Based  Models  to  identify  complex  interactions  that  occur  with  the  use  of  new 
technologies  and  how  these  models  can  be  used  in  the  analysis  of  potential  future  weapon  systems.  We  explore  the  potential 
gains  available  in  combat  modeling  from  the  inclusion  of  complexity  in  the  modeling  process  under  the  guise  of  modeling  the 
FCS  in  an  agent-based  model. 


Cadet  Ira  Crofford 
Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10966 


Colonel  William  B.  Carlton,  Professor 
Department  of  Systems  Engineering 
United  States  Military  Academy 
West  Point,  NY  10966 


Emergency  Preparedness  Incident  Command  Simulation 


Julie  Seton,  Ph.D. 

TRADOC  Analysis  Center 
ATRC  -  WS,  WSMR,  NM  88002 
(505)  678-4949;  FAX  (505)  678-1970 
setoni.contractor@trac.wsmr.armv.mil 


Randall  M.  Parish,  Ph.D. 

TRADOC  Analysis  Center 
ATRC  -  WJ,  WSMR,  NM  88002 
(505)  678-1950;  FAX  (505)  678-4866 
parishr@trac.wsmr.armv.mil 
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The  Emergency  Preparedness  Incident  Command  Simulation  (EPiCS)  is  a  tool  for  crisis  managers  and  their  staffs  to 
exercise  command  and  control  in  a  realistic  but  simulated  environment.  EPiCS  can  be  used  to  train  operations  command  and 
control  personnel,  rehearse  operations,  evaluate  operations  plans,  analyze  systems  effectiveness,  and  develop  techniques  and 
procedures.  EPiCS  allows  for  agencies  at  local,  county,  state,  and  federal  levels  to  exercise  their  command  structure  at 
multiple  levels  and,  at  the  same  time,  allow  many  agencies  to  interact  and  develop  or  exercise  procedures  for  interagency 
cooperation  across  jurisdiction  boundaries. 

Over  the  last  two  years,  TRAC-WSMR  has  conducted  four  EPiCS  exercises  sponsored  by  the  National  Institute  of 
Justice.  These  exercises  have  involved  various  disaster/crisis  scenarios  including  a  prison  riot,  shootings  in  a  school,  public 
disturbances  that  required  mass  arrests,  and  terrorist  attacks  that  triggered  a  weapon-of-mass  destruction  (WMD)  release  in  a 
major  city  subway.  The  methods,  processes,  and  results  of  the  project  are  described.  TRAC-WSMR  has  agreed  to  conduct 
overlapping  training  exercise  cycles  using  EPiCS  for  the  Defense  Threat  Reduction  Agency,  (DTRA)  to  analyze  and  evaluate 
site  safety  response  plans  and  procedures. 

The  plans  and  emerging  results  of  these  efforts  will  be  outlined  and  discussed 

Multi-Domain  Counter-Terrorism  Modeling 

Roger  Smith 

Titan  Systems  Corp. 

3361  Rouse  Road,  Suite  200 
Orlando,  FL  32817 
(407)  977-3310 
FAX  (407)  381-2930 
rdsmith@titan.com 

A  model  of  terrorist  organizations  and  their  activities  must  address  each  of  the  components  of  a  terrorist  network  -  the 
command  nucleus,  field  cell,  group  communications,  national  hosts,  sympathizers,  and  support  assets.  Together  these  create 
a  network  that  enables  a  small  group  to  conduct  guerilla  warfare  against  any  target  in  the  world.  Modeling  our  response  to 
these  components  will  require  more  than  traditional  interactive  or  analytic  simulations.  An  appropriate  simulation  must 
include  the  resources  and  missions  of  1)  physical  assets  like  the  traditional  military,  special  forces,  security  systems  and 
personnel,  and  emergency  management  teams;  2)  intelligence  collection  against  domestic  and  foreign  targets;  3)  political 
actions  against  governmentally  sponsored  activities;  4)  legal  actions  against  non-governmental  sympathizers  and 
organizations  that  support  terrorists;  5)  financial  and  economic  sanctions  targeted  at  assets  belonging  to  terrorists  and  nations 
that  host  them;  and  6)  cultural  influences  on  potential  terrorist  recruits,  national  sentiment,  and  media  representation.  This 
presentation  will  discuss  potential  frameworks  for  approaching  this  problem  and  discovering  the  algorithms,  variables,  and 
relationships  for  such  a  system. 

Artificial  Warfare:  Using  Agent  Based  Simulations  for  the  Study  of  Conflict 

Steve  Upton 

The  MITRE  Corporation 

2907  W.  Bay  to  Bay  Blvd,  Ste  303 

Tampa,  FL  33829 

(813)  831-5535 

FAX  (813)  831-4661 

upton@mitre.org 

Artificial  Warfare  is  the  practice  of  studying  the  art  of  war  using  computational  models  of  many  simple  interacting 
agents  following  well-defined  rules.  We  calls  these  agent-based  simulations  distillations,  to  reflect  their  nature  as  extractions 
and  abstractions  of  the  essential  elements  of  warfare.  As  part  of  the  Marine  Corps’  Project  Albert,  we  have  developed  and 
sponsored  development  a  variety  of  distillations.  We  begin  by  describing  general  characteristics  of  distillations,  their 
relationship  to  other  tools  for  the  study  of  warfare,  and  then  discuss  several  of  the  distillations  that  are  openly  available.  We 
also  discuss,  through  examples,  several  current  and  potential  uses  of  these  distillations,  to  include,  developing  intuition, 
exploring  concepts,  formulating  meta-models,  and  assisting  in  the  design,  analysis  and  extrapolation  of  simulation  and  field 
experiments.  We  suggest  these  tools  are  useful  additions  to  any  analyst’s  toolbox. 
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Verification,  Validation,  and  Accreditation  of  MUVES/S2  for  U.S.  Army  System  Evaluations  of 
Ground  Combat  and  Munitions  System 

Wendy  Winner 

USARL/SLAD 

AMSRL-SL-BA,  APG,  MD  21005-5068 
(410)  278-6339;  FAX  (410)  278-6307 
wendv@arl.army.mil 

For  DoD  and  service  decision  makers,  technically  astute  and  fiscally  sound  testing  is  critical  to  accurately  quantify  the 
survivability  and  lethality  of  U.S.  ground  combat  and  munitions  systems  in  analysis  models  and  wargames.  At  the  weapon 
system  level,  deliberate  Army  experimentation  has  been  used  to  fill  critical  data  voids  and  to  develop  new  model  algorithms. 
These  efforts  have  proven  instrumental  to  incrementally  extending  the  applicability  of  the  tri-service  AJEM/  MUVES-S2 
analysis  code  for  ballistic  survivability/vulnerability/lethality  analyses  of  U.S.  Army  and  foreign  weapon  systems.  These 
rigorous  efforts  are  providing  a  critical  foundation  for  analyzing  new  and  emerging  weapon  system  technologies.  Algorithm 
and  code  advances  are  also  supporting  Analyses  of  Alternatives,  U.S.C.  Title  10  Live  Fire  Testing,  and  DoD  5000.2.  In 
February  2001,  the  Army  Test  and  Evaluation  Command  (ATEC)  accredited  MUVES/S2  for  use  in  system  effectiveness 
evaluations  to  support  the  Bradley  M2A3  program  and  for  use  in  shot  line  analyses,  live  fire  pre-shot  predictions,  and 
generating  full- view  system-level  metrics  for  combat  systems  and  munitions.  In  December  2001,  the  Army  Research 
Laboratory  presented  another  compelling  MUVES/S2  validation  package  to  ATEC  for  the  BAT  program.  These  efforts  will 
be  leveraged  to  support  other  munitions  in  Army  development  such  as  GMLRS  and  P3I  BAT.  This  paper  succinctly 
describes  the  analytical  approach,  testing  methods,  analysis  techniques,  and  modeling  advances  that  are  being  applied  to 
support  the  evaluation  of  ground  combat  and  munitions  systems  for  current  and  future  frontiers. 
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Modeling  Maneuver  Warfare  Using  SEAS 


Captain  Jeffrey  Del  Vecchlo 

2420  Vela  Way,  Suite  1467 

Los  Angles  AFB,  El  Segundo,  CA  90245-5081 

(310)  363-0768,  ieffrev.delvecchio@losangles.af.mil 


Lt.  Clinton  Clark 

2420  Vela  Way,  Suite  1467 

Los  Angles  AFB,  El  Segundo,  CA  90245-5081 

(310)  363-6592,  clinton.clark@losangeles.af.mil 


The  goal  of  military  education  is  to  help  soldiers  understand  the  nature  of  war  and  to  teach  them  how  to  think  logically 
and  creatively  about  war  and  during  war.  Every  great  military  leader  understood  that  success  in  battle  is  attributed  to  well- 
trained  forces.  We  intend  to  show  that  wargaming  can  play  a  major  role  in  the  course  of  instructing  maneuver  warfare 
techniques.  Modeling  and  Simulation  has  a  pivotal  role  to  play  in  providing  trainers  with  sound  analytical  support  on 
training  activities  designed  to  teach  maneuver  warfare.  Our  study  employed  Systems  Effectiveness  Analysis  Simulation 
(SEAS),  an  AF  Toolkit  campaign  level  model.  In  the  past  SEAS  has  been  used  by  senior  AF  decision  makers  to  determine 
future  space  systems  policy.  Future  uses  could  be  to  provide  analytical  support  to  scenario  construction  and  evaluation  of  the 
learning  process,  for  individual  or  collective  training.  Our  research  applies  the  maneuver  warfare  principles  from  the 
Maneuver  Warfare  Handbook  at  the  company  level  and  below.  It  can  be  used  to  teach  students  to  make  educated  decisions 
through  a  coherent,  logical  thought  process.  Advanced  techniques  such  as  unit  skills,  conducting  a  specific  type  of  attack, 
and  employing  combined  arms  can  be  taught  and  demonstrated.  The  SEAS  model  was  developed  in  such  a  way  that  it  allows 
for  “tactical  programming”,  which  permits  the  application  of  maneuver  warfare  techniques.  Most  computerized  games  try  to 
decide  “who  won”  by  rewarding  “kills”.  SEAS,  however,  is  designed  to  give  the  decision  maker  or  instructor  or  student 
insight  into  the  effects  of  variables.  There  is  no  right  answer  in  maneuver  warfare,  only  timely  and  logical  ones. 


Exploring  the  Validation  of  Lanchester  Equations  for  the  Battle  of  Kursk 

Captain  John  Dinqes,  USA,  Dr.  Tom  Lucas  and  Lieutenant  Turker  Turkes,  Turkish  Army 

Dr.  Tom  Lucas 

Naval  Postgraduate  School 

Monterey,  CA  93943 

(831)  656-3039 

twlucas@nps.navv.mil 


This  research  explores  the  validation  of  Lanchester  equations  as  models  of  the  attrition  process  for  the  Battle  of  Kursk  in 
World  War  II.  The  methodology  and  results  of  this  study  extend  previous  validation  efforts  undertaken  since  the 
development  of  the  Ardennes  Campaign  Simulation  Data  Base  (ACSDB)  in  1989  and  the  Kursk  Data  Base  (KDB)  in  1996. 
The  KDB  is  a  computerized  database  developed  by  the  Dupuy  Institute  and  the  Center  for  Army  Analysis  from  military 
archives  in  Germany  and  Russia.  The  data  are  two-sided,  time-phased  (daily),  highly  detailed,  and  encompass  15  days  of  the 
campaign.  This  work  examines  how  the  various  derivatives  of  Lanchester ’s  equations  fit  the  newly  compiled  database  on  the 
Battle  of  Kursk.  In  addition,  the  effect  of  using  purely  engaged  forces,  in  contact  forces,  and  all  forces  in  parameter 
estimation  is  examined. 


The  Need  to  Further  Educational  Wargaming 


Capt  Chad  Erspamer 

Air  Force  Wargaming  Institute 
620  Chennault  Circle 
Maxwell  AFB,  AL  36112 
(334)  953-4843 

chad.erspamer@maxwell.af.mil 


Scott  Matthes 

Air  Force  Wargaming  Institute 
620  Chennault  Circle 
Maxwell  AFB,  AL  36112 
(334)  953-4735 
scott.matthes@maxwell.af.mil 
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Approved  abstract  unavailable  at  printing. 

Objective  Force  Concept  Exploration ,  A  Notional  Combat  Battalion  Engagement 

MAJ  Paul  J.  Finken 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 
913-684-9169;  fax  9189 
fi  nkenp  @  trac .  army .  mi  1 

This  study  supports  Objective  Force  Combat  Battalion  concept  development  and  the  Army  Transformation.  It  focused 
on  developing,  examining,  and  refining  Combat  Battalion  concepts,  and  supporting  the  Future  Combat  System  (FCS) 
Mission  Needs  Analysis. 

The  study  scenario  facilitates  analysis  of  the  Objective  Force  in  combat  operations.  The  scenario  provides  a  context  in 
which  an  Objective  Force  Combat  Battalion  conducts  offensive  operations  in  2015  against  a  technologically  advanced  Red 
force.  The  engagement  was  explicitly  modeled  using  the  Interactive  Distributed  Engineering  Evaluation  and  Analysis 
Simulation  (IDEE  AS)  model.  IDEE  AS  is  an  entity-based  simulation,  capable  of  force-on-force  representations,  that  permits 
examination  of  concepts  and  parametric  analysis  at  the  engineering  level  of  detail.  Use  of  the  notional  battalion  force 
structure  allowed  O&O  concept  exploration  prior  to  force  design  decisions. 

This  study  contributed  substantially  to  the  development  of  the  Objective  Force,  especially  with  regard  to  the  Unit  of 
Action  force  design.  In  addition  to  the  development  of  concepts,  tactics,  and  insights  for  future  operations  the  study  provided 
a  powerful  visualization  of  this  future  force.  The  scenario  and  base  case  developed  during  this  study  were  used  extensively 
by  the  TRADOC  Unit  of  Action  Task  Force  in  their  subsequent  refinement  of  the  force  design.  These  tools  were  also  used 
by  the  Army  Medical  Department  in  its  transformation  wargame  effort. 

This  presentation  will  provide  an  overview  of  the  study  scenario’s  purpose,  methodology  and  results. 

Wargaming  to  Support  Objective  Force  Concept  Development 

Rochelle  A.  Hill 

TRADOC  Analysis  Center 
255  Sedgwick  Ave. 

Ft.  Leavenworth,  KS  66027 
913-684-9320;  fax  9189 
hillr@trac.armv.mil 

The  Objective  Force  is  the  realization  of  the  Army  vision  that  was  presented  by  the  Chief  of  Staff  of  the  Army  (CSA)  in 
October  1999.  The  transformation  from  vision  to  fielded  Objective  Force  is  a  process  that  will  occur  over  several  decades. 
An  early  and  critically  important  piece  of  this  process  is  the  development  of  Operational  and  Organizational  (O&O) 
Concepts.  These  Objective  Force  O&O  concepts  are  grounded  in  the  futures  work  that  was  done  as  part  of  the  Army  After 
Next  (AAN)  project.  Futures  wargaming  has  evolved  to  become  an  important  part  in  the  development  of  these  concepts.  In 
particular,  the  annual  Army  Transformation  Wargame  (ATWG)  has  emerged  as  the  Army’s  most  visible  event  for  future 
concept  development. 

The  TRADOC  Analysis  Center  (TRAC)  serves  as  the  lead  analytic  agency  for  the  ATWG  sponsored  by  the  TRADOC 
Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  This  series  of  wargames  is  designed  to  describe,  refine  and  evaluate 
Objective  Force  concepts  and  capabilities  over  a  multi-year  period.  These  wargames  provide  the  Army  an  opportunity  to 
explore  future  Army  operations  at  the  strategic  and  operational  levels  of  war  in  a  political/military  wargame  environment. 

This  presentation  will  address  the  analytic  support  provided  to  ATWG  01,  Vigilant  Warriors.  In  particular,  it  will 
provide  an  overview  of  the  wargame  to  include  analysis  and  reporting  of  the  insights  for  the  issues  addressed. 
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Modeling  and  Wargaming  of  Future  Combat  Systems  at  TRAC-WSMR 

Captain  Michael  Kirkland  Major  Richard  O’Donnell  Randall  M.  Parish,  Ph.D. 

TRADOC  Analysis  Center  TRADOC  Analysis  Center  TRADOC  Analysis  Center 

ATRC  -  WJ,  WSMR,  NM  88002  ATRC  -  WJ,  WSMR,  NM  88002  ATRC  -  WJ,  WSMR,  NM  88002 

(505)  678-7869;  FAX  (505)  678-4866  (505)  678-5585;  FAX  (505)  678-4866  (505)  678-1950;  FAX  (505)  678-4866 

kirklandmg@trac.wsmr.army.mil  odennellri  @trac.  wsmr.armv.mil  parishr@trac.wsmr.armv.mil 

Simulation  Based  Acquisition  for  future  weapons  systems  entails  a  cradle  to  grave  program  in  which  modeling  and 
simulation  is  used  in  the  earliest  stages  of  weapons  systems  development  throughout  engineering  and  manufacturing,  test  and 
evaluation,  and  ending  with  a  simulation  that  soldiers  use  for  training. 

TRADOC  Analysis  Center- WSMR  was  truly  on  the  cutting  edge  of  the  earliest  stages  of  concept  exploration  of  the 
Future  Combat  Systems  acquisition  program.  The  Defense  Advanced  Research  Projects  Agency  (DARPA)  and  the  U.S. 
Army  selected  four  contractor  teams  for  the  Concept  Exploration  and  Design  phase  of  the  Future  Combat  Systems  (FCS) 
program.  The  Government’s  intent  for  the  four  contracting  teams  was  to  develop  a  virtual  FCS  using  the  Army’s  Simulation 
and  Modeling  for  Acquisition,  Requirements  and  Training  (SMART)  concept.  The  original  intent  included  competition 
among  the  teams  for  the  best  ideas  and  concepts  for  the  FCS  system.  The  four  teams  alternated  visits  to  TRAC-WSMR 
working  with  model  programmers  to  ensure  their  concepts  were  modeled  as  close  as  possible  to  ensure  the  most  realistic 
simulations  of  their  concepts.  From  October  2000  through  September  2001  the  contractors  and  TRAC  personnel  developed, 
refined,  and  analyzed  the  concepts. 

The  modeling  and  simulation  efforts  truly  reflected  the  intent  of  the  of  Army’s  acquisition  strategy  to  use  SB  A  at  the 
earliest  stages  of  acquisition  programs.  The  results  of  the  many  runs  reflected  in  changes  in  the  contractor’s  force 
compositions,  doctrine,  TTPs,  weapons  choices,  sensor  package  choices,  etc. 


Experimentation  within  the  C2  Operation  Centers  -  The  Design  of  a  Quick-Draw  Time  Critical 
Targeting  Team 


Capt.  Edward  P.  McCormick. 

AFRL/HEAI  Brooks  AFB 
DSN  240-1911 
COMM  210  536-1911 
FAX  210  536-6461 


Mr.  Michael  S.  Goodman,  Mr.  Michael  W.  Garrambone,  Ms  Debra  Hall  and  Mr. 
Evan  Rolek 
Veridian  Engineering 
5200  Springfield  Pike,  Suite  200, 

Dayton,  OH  45431-1289 

Com  927-476-2527,  Fax:  (937)  476-2900,  mike.goodman@veridian.com 


Twenty-first  century  warfare  has  mandated  the  gunfighter  approach  to  finding  and  shooting  targets.  This  means  finding, 
fixing,  tracking,  targeting,  engaging  and  assessing  quickly,  before  the  window  of  opportunity  passes  and  the  speed  of 
decision  assures  the  target  no  room  for  shelter.  In  JEFX  2000  we  saw  this  mechanism  paint  a  coherent  picture  of  the 
battlespace  and  formulate  C2  responses  in  a  distributed  environment.  Based  upon  that  picture  we  constructed  a 
representative  team,  one-fifth  the  original  size  with  detailed  descriptions  of  missions,  tasks,  and  informational  flows.  This 
structure  will  be  required  to  manage  larger  and  larger  quantities  of  battlespace  information  but  will  do  it  more  quickly  in 
situations  where  individuals  and  teams  can  work  out  their  battle  rhythms.  This  will  happen  first  in  a  laboratory- like 
environment  which  can  train,  test,  assess  and  improve  performance  at  both  the  individual  and  team  level.  This  presentation 
will  describe  the  assessment  approach  and  methodology  employed  by  the  Air  Force  Research  Laboratory’s  Warfighter 
Training  Research  Division  (AFRL/HEA)  researchers  as  they  observed  the  C2  operators  in  the  Time  Critical  Targeting  Cell 
(TCTC)  during  JEFX  2000.  The  AFRL/HEA  researchers  followed  a  human-factors  oriented  approach  to  gain  insight  into  the 
scope  of  issues  confronting  personnel  in  modern  Air  Operation  Centers.  These  insights  will  ultimately  drive  the  C2  operator 
training  requirements  and  help  characterize  the  individual  and  team  “desired”  performance  capabilities. 


Using  Analytical  Simulations  to  Improve  Performance  of  the  Warfighter's  Simulation 


Mr.  N.  Kevin  Nquven 

US  Army  STRICOM 

12350  Research  Parkway,  Orlando,  FL  32826 
Phone:  407-384-3768,  FAX:  407-384  5730 
NguvenN@stricom.armv.mil 


LTC  George  Stone  III 
JWARS 

1555  Wilson  Blvd.  #620,  Arlington,  VA  22209 
Phone:  703-696-9490,  FAX:  703-696-  9563 
George.Stone@osd.pentagon.mil 


The  robustness  of  training  simulations  continues  to  skyrocket  as  the  power  of  computers  drastically  increases  in 
accordance  with  Moore’s  Law.  Without  being  careful  though,  extra  burdens  demanded  by  trainers  in  behavior  and  fidelity 
will  slow  execution  times  to  an  unacceptable  level.  Computer-based  simulations,  such  as  the  WARfighters’  SIMulation 
(WARSIM),  represent  systems  and  forces  built  from  a  complex  and  functional  description  of  military  land  warfare.  The 
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computerized  battlespace  that  WARSIM  model  for  training  joint,  corps  and  divisional  commanders  and  their  staffs  can 
become  unwieldy  in  size  and  functionality.  Functionality  is  key,  but  next  comes  performance  of  the  simulation  as  it  portrays 
combat  and  its  related  behaviors,  environments  and  functions.  One  must  assess  the  performance  of  the  large-scale  simulation 
to  determine  and  justify  the  appropriate  suite  of  fielded  hardware,  software  and  network.  Logistical  support  personnel  and 
training  site  coordinators  need  to  know  whether  newly-built  and  equipped  simulation  centers  will  adequately  handle  the  size 
of  a  specific  training  scenario.  Proactive  efforts  to  analyze  and  predict  the  processes  and  associated  impacts  on  performance 
are  critical.  Using  a  performance  prediction  model,  the  analytical  results  may  help  reduce  time,  resources,  and  risks 
associated  with  the  processes  of  the  training  system  being  acquired.  The  WARSIM  Performance  Emulation  Model  shows 
and  predicts  how  a  training  simulation  will  perform.  The  results  from  the  findings  help  guide  the  development  of  the  actual 
WARSIM  system  components.  This  paper  describes  the  use  of  a  commercial  off-the-shelf  simulation  package  to  emulate 
WARSIM  and  discusses  the  potential  application  to  other  simulation  models  for  applying  analytical  tools  that  predict 
performance. 

Conventional  Weapon  Systems  and  Homeland  Security:  A  First  Look 

Richard  Phares 

Booz,  Allen  &  Hamilton 

3190  Fairview  Park  Drive 

Falls  Church,  VA  22042 

(703)  284-5356  (703)  289-5837  (Fax) 

phares.rich@bah.com 

As  part  of  the  immediate  response  to  the  events  of  1 1  September  2001,  two  PERRY  class  frigates  and  one  SPRUANCE 
class  destroyer  sortied  from  their  respective  homeports  and  took  up  assigned  defensive  positions  inside  Puget  Sound.  The 
SPRUANCE  was  assigned  to  defend  NAVSUBASE  Bangor,  and  the  ballistic  missile  submarines  based  there.  The  two 
PERRY’s  were  assigned  to  defend  metropolitan  Seattle,  and  NAVSTA  Bremerton,  and  the  nuclear  capable  shipyard  there. 
Air  cover  for  the  region  was  provided  by  Air  Force  elements  based  out  of  Portland,  OR.  The  problem  with  this  assignment 
was  not  the  obvious  beneficial  psychological  boost  to  the  local  civilian  population,  but  rather  the  capability  of  the  sensors  and 
weapon  systems  on  each  if  these  platforms  to  defeat  the  perceived  threat.  Specifically,  it  is  the  authors  contentions  that  these 
platforms,  while  designed  for  and  capable  of  conducting  combat  against  conventional  targets,  were  ill-equipped  to  deal  with 
a)  multiple  attacks  by  commercial  aircraft,  b)  car  bomb  equipped  ferries,  or  c)  other  asymmetric  physical  threats.  This  paper 
examines  why  this  is  so,  and  provides  some  recommendations  on  future  weapon  systems  to  counter  these  threats. 


Joint  Data  Support 


Dr.  James  G.  Stevens,  GS-15 
OSD  OD/PA&E  (JDS) 

1225  Jefferson  Davis  Hwy  Ste  200 
Arlington,  VA  22202 
(703)414-1940;  Fax,  x-8114 
iames.stevens@osd.pentagon.mil 


Mr.  R.  Eric  Johnson 

Joint  Data  Support  /  Unisys  Corp. 

1225  Jefferson  Davis  Hwy  Ste  200 

Arlington,  VA  22202 

(703)  414-1924;  Fax,  x-8114 

eric.iohnson@osd.pentagon.mil 


Joint  Data  Support  (JDS)  is  a  component  of  the  Joint  Analytic  Model  Improvement  Program  (JAMIP),  under  the 
administration  of  the  Office  of  the  Secretary  of  Defense  (Program  Analysis  and  Evaluation),  with  funding  from  the  Joint 
Staff  (J-8).  The  charter  of  JDS  is  to  provide  and  manage  data  for  DoD  analytical  studies  along  a  broad  customer  base, 
including  both  studies  using  “JAMIP”  simulations  (MIDAS,  TACWAR,  ITEM,  ELIST,  VIC,  and  EADSIM),  and  those  using 
other  decision  support  processes  (e.g.,  the  DYNAMIC  COMMITMENT  seminar  wargame).  The  charter  of  JDS  also  includes 
support  for  development  and  fielding  of  the  Joint  Warfare  System  (JWARS). 

JDS  operates  according  to  a  rigorous  yet  flexible  Study  Support  Process.  This  brief  will  provide  details  of  that  process, 
including  JDS  principles  and  challenges.  There  will  be  several  recent  examples  of  JDS-provided  data  support.  A  large 
portion  of  this  brief  will  cover  data  support  for  the  development  and  fielding  of  JWARS. 


Artificial  Warfare:  Using  Agent  Based  Simulations  for  the  Study  of  Conflict 


Steve  Upton 

The  MITRE  Corporation 

2907  W.  Bay  to  Bay  Blvd,  Ste  303,  Tampa,  FL  33829 
(813)  831-5535;  FAX  (813)  831-4661,  upton@mitre.org 

Artificial  Warfare  is  the  practice  of  studying  the  art  of  war  using  computational  models  of  many  simple  interacting 
agents  following  well-defined  rules.  We  calls  these  agent-based  simulations  distillations,  to  reflect  their  nature  as  extractions 
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and  abstractions  of  the  essential  elements  of  warfare.  As  part  of  the  Marine  Corps’  Project  Albert,  we  have  developed  and 
sponsored  development  a  variety  of  distillations.  We  begin  by  describing  general  characteristics  of  distillations,  their 
relationship  to  other  tools  for  the  study  of  warfare,  and  then  discuss  several  of  the  distillations  that  are  openly  available.  We 
also  discuss,  through  examples,  several  current  and  potential  uses  of  these  distillations,  to  include,  developing  intuition, 
exploring  concepts,  formulating  meta-models,  and  assisting  in  the  design,  analysis  and  extrapolation  of  simulation  and  field 
experiments.  We  suggest  these  tools  are  useful  additions  to  any  analyst’s  toolbox. 

Generating  Surprise:  Using  Natural  Heuristics  in  the  Search  for  Novelty 

Stephen  C.  Upton 

The  MITRE  Corporation 
2907  W  Bay  to  Bay,  Ste.  303 
Tampa,  FL  33629 

(813)  831-5535,  Fax:  (813)  835-4661 
upton@mitre.org 

Any  non-trivial  combat  simulation  is  characterized  by  very  large  input  spaces,  where  the  input  may  be  in  the  form  of 
simple  parameter  settings  to  more  complicated  data  structures.  Each  “point”  in  this  space  can  be  viewed  as  a  possible 
solution  to  a  problem  confronting  the  agents  in  the  simulation.  We  can  explore  this  space  looking  for  novel  or  surprising 
solutions  using  a  class  of  algorithms  called  natural  heuristics.  Natural  heuristics  are  optimization  techniques  inspired  by 
analogy  to  phenomena  in  the  natural  world.  The  heuristics  include  such  algorithms  as  simulated  annealing,  immune 
algorithms,  and  genetic  algorithms.  As  part  of  the  Marine  Corps'  Project  Albert,  we  are  developing  a  new  set  of  techniques 
based  on  these  natural  heuristics  to  search  for  novelty  in  these  large  simulation  spaces.  We  will  discuss  our  first  experiments 
applying  this  new  methodology  to  agent-based  simulations  in  the  context  of  terrorism  questions  in  tactical  settings. 


Simulation-based  Technology  and  Investment  Planning  Experiment  (STIPE)  Campaign  Modeling  as 
Applied  on  the  SensorCraft  Technology  Assessment 


James  Zeh 

AFRL/VACD 
2241  Avionics  Circle 
WPAFB,  OH  45433 
(937)  904-6571  (fax  (937)  656-4339) 
iames.zeh@wpafb.af.mil 

Chris  Linhardt 
Veridian  Engineering 
5200  Springfield  Pkie 
Dayton,  OH  4543 1 
(937)  476-2582  (fax  (937)  476-2900) 
chris.  linhardt  @  veridian.com 

The  goals  of  STIPE  are  to  reduce  the  time  and  cost  for  developing  and  maturing  promising  Uninhabited  Air  Vehicle 
(UAV)  technologies,  to  integrate  the  technologist  and  the  warfighter  into  the  Science  and  Technology  (S&T)  acquisition 
process,  and  to  provide  analytical  input  into  the  Air  Force  S&T  planning  process.  STIPE  combines  engineering-level 
modeling,  design  and  analysis  tools,  mission-  and  campaign-level  simulations,  and  cost  analysis  tools  in  a  simulation 
environment  to  provide  analytic  information  to  support  investment  decisions  in  the  Science  and  Technology  arena.  This 
simulation  environment  will  provide  the  capability  for  researchers  to  evaluate  the  impact  of  different  UAV  technologies  in  a 
warfighting  environment,  providing  a  link  between  AFRL  technologies  and  warfighter  mission  needs. 

The  STIPE  simulation  environment  is  being  applied  on  the  SensorCraft  Technology  Assessment  as  a  proof  of  concept. 
AFRLs'  SensorCraft  initiative  is  an  advanced  multi-sensor  UAV  for  standoff  ISR.  This  presentation  focuses  on  the  campaign 
level  analysis  performed  in  support  of  the  SensorCraft  Technology  Assessment.  The  goal  of  the  campaign  analysis  is  to 
provide  operational  measures  of  merit  for  return  on  investment  (ROI)  analysis  to  identify  promising  candidate  SensorCraft 
concepts.  The  variables  derived  from  the  candidate  technologies  include  the  basing  concept,  air  vehicle  endurance,  air  vehicle 
RCS,  mean  time  between  critical  failure  (MTBCF),  mean  time  to  repair  (MTTR),  ground  moving  target  indicator/tracker 
(GMTI/T)  performance,  spot  synthetic  aperture  radar  (SAR)  performance,  and  air  moving  target  indicator  (AMTI) 
performance.  The  primary  measures  of  merit  at  the  campaign  level  are  kills  by  target  type  and  campaign  duration  required  for 
operational  task  objectives. 


Terry  Brown 

Veridian  Engineering 

5200  Springfield  Pkie 

Dayton,  OH  45431 

(937)  476-2514  (fax  (937)  476-2900) 

terry.brown@veridian.com 
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Joint  Virtual  Battlespace  (JVB)- A  Concept  Evaluation  Environment 

Dr.  Rob  Alexander 

SAIC 

1 100  N.  Glebe  Rd.,  Suite  1 100,  Arlington,  VA  22201 

(301)  807-3569,  Fax:  (703)  923-2256,  ralexander@sito.saic.com 

“The  Army  must  change.”  So  says  LtGen  John  Riggs,  Director  of  Objective  Force  Task  Force.  But  how  should  it 
change?  To  understand  how  best  to  transform  the  Army  to  fulfill  the  defense  needs  of  the  nation  in  the  21st  Century,  there  is 
a  requirement  for  detailed,  yet  broad  analysis  of  proposed  concepts.  Broad  analysis  must  be  done  to  insure  the  applicability 
of  concepts  and  developmental  systems  in  the  context  of  likely  and  plausible  future  military  scenarios.  Yet  the  analysis  must 
also  dive  deep  into  the  details  of  information  flow,  communications,  situational  awareness,  weapons  and  survivability,  and  at 
the  same  time  support  development  of  a  wide  family  of  new  systems  (Future  Combat  System)  and  others.  Stovepipe  analysis 
of  a  single  weapon  system,  using  a  set  of  standard  standalone  simulations,  will  not  meet  this  requirement.  Instead,  the  Army 
and  Joint  Precision  Strike  Demonstration  are  building  an  evaluation  environment  called  Joint  Virtual  Battlespace  (JVB)  using 
the  SMART  (Simulation  &  Modeling  for  Acquisition,  Requirements  and  Training)  process.  JVB  is  using  distributed 
simulation  to  incorporate  the  best  existing  models  and  simulations  as  needed  for  evaluation  of  C4ISR  warfighting  concepts. 
The  emphasis  in  JVB  is  on  integrating  existing  tools,  not  building  new  components  unless  absolutely  necessary  to  bridge 
gaps  between  legacy  models.  The  environment  is  tailorable  to  analysis  needs  by  incorporating  various  tools  when  they  are 
needed  to  answer  specific  questions.  And  is  this  not  how  analysis  should  work?  First  formulate  the  question,  and  only  then 
select  or  build  a  tool  to  help  answer  it. 

The  current  focus  of  JVB  is  to  support  Objective  Force  and  Future  Combat  Systems  analysis  of  alternatives  for 
TRADOC  Analysis  Center.  For  this  effort,  JVB  is  gathering  a  variety  of  models  and  simulations  from  STRICOM, 
Department  of  Energy’s  Sandia  National  Laboratory,  the  Army  Research  and  Development  Engineering  Center,  and  other 
agencies  and  contractors.  In  the  coming  years,  JVB  will  provide  a  robust,  tailorable,  and  focused  tool  set  to  answer  the 
question  “How  should  the  Army  change?” 

Food  for  Feedback:  An  Operations  Analysts  Reference  on  Wartime  Data  Collection 

Richard  Bird 

(703)  696-0744 
Richard.Bird@pentagon.af.mil 

Approved  abstract  unavailable  at  printing. 

Pythagoras:  The  Newest  Member  of  the  Project  Albert  Family 

Edmund  J.  Bitinas 

TRW 

1895  Preston  White  Dr.,  Reston,  VA  20191-5434 

(703)  648-0137,  Fax:  (703)  648-2458,  Edmund.bitinas@trw.com 

Pythagoras  is  a  new  Agent-based  distillation,  being  developed  to  supplement/complement  the  Project  Albert  family  of 
distillations,  which  include  Mana,  Socrates  and  Isaac.  Pythagoras  brings  new  capabilities  to  this  family,  such  as  Soft 
Decision  Rules,  Dynamic  Sidedness,  Behavior-Change  Triggers  and  Non-Lethal  Weapons.  Soft  Decision  Rules  create 
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instances  of  Agents  from  the  same  Agent  class  that  have  behaviors  that  are  unique  from  one  another.  Dynamic  Sidedness 
allows  Agents  to  change  sides  as  a  function  of  actions  and  events  that  they  encounter.  Behavior-Change  Triggers  allow 
Agents  to  change  their  behavior  as  a  function  of  actions  or  events.  Non-Lethal  Weapons,  not  only  cause  suppression,  but 
may  also  change  the  sidedness  or  affiliation  of  an  Agent.  Pythagoras  Scenarios  include  a  Cave  Search  scenario  in  which 
Marines  look  for  an  elusive  Agent.  A  Peace  Keeping  Scenario  has  also  been  built  in  which  Marines  use  short-range  non- 
lethal  weapons  (like  leaflets  or  food)  to  sway  the  affiliation  of  villagers,  while  an  enemy  is  broadcasting  propaganda  with  an 
indirect  fire  non-lethal  weapon  (a  bull  horn)  to  sway  them  against  the  Marines.  Pythagoras  is  written  in  JAVA,  and  is  hosted 
at  the  Maui  High  Performance  Computing  Center,  where  it  is  available  for  data  farming  -  executing  large  numbers  of 
repetitions  of  parametric  runs  to  identify  areas  of  unexpected  behaviors  and  non-linear  results  in  a  co-evolving  landscape. 

Strategies  and  Techniques  for  Automation  of  Data  Management  and  Reduction  to  Support  Real  - 
Time  and  Near  Real-Time  Data  Analysis. 

David  Blessinger 

OSD  JCAS 

202  Cherokee  Avenue,  Suite  1 
Eglin  AFB,  FL  32542-5602 
(850)  882-91 16,  Fax:  (850)  882-91 17 
david.blessinger@eglin.af.mil 

The  JT&E  programs  like  many  other  test  and  evaluation  programs  collect  large  quantities  of  data  to  answer 
measures  of  performance  (MOPs),  measures  of  effectiveness  (MOEs),  and  program  issues.  Often  subject  matter  experts 
and  the  analysts  are  called  upon  to  provide  short  notice  or  quick-look  analyses  and  summaries  of  the  data,  MOEs,  and 
MOPs.  Limited  time,  personnel,  and  resources  can  make  this  a  rather  daunting  task.  Even  supporting  interim  and  final 
reports  can  present  a  challenge  to  the  analysis  group.  With  the  advances  in  computer  software,  a  well-designed  data 
management  and  analysis  program  can  make  report  generation  and  quick-look  support  quite  manageable.  The  key  to 
efficient  use  of  computer  resources  is  selecting  the  appropriate  software  for  the  task  at  hand.  i.e.  using  Access  for  data 
management,  relationships,  and  merging  data  while  using  the  SPSS  statistical  program  for  advanced  statistics  and 
presentation  efforts. 

The  Joint  Close  Air  Support  (JCAS)  Joint  Test  Force  (JTF)  has  a  very  complex  model,  which  includes  over  260  MOPs 
and  MOEs,  to  describe  the  joint  close  air  support  process.  To  manage  the  data  and  automate  the  data  analysis,  a  relational 
database  was  developed  using  Microsoft  Access.  Access  was  able  to  mathematically  model  the  JCAS  process  by  providing 
relational  links  between  the  tables  (sub  processes).  These  relational  links  also  provided  the  capability  to  merge  test 
conditions  with  appropriate  test  measures.  The  power  of  Access  permitted  real-time  updates  of  test  measure  data  and  quick- 
look  analysis  of  test  measures  and  test  conditions.  Through  visual  basic  programming  and  export  of  test  measure  data  to 
Excel,  near  real-time  readouts  of  all  test  measure  values  and  some  descriptive  statistics  were  available  with  breakouts  by 
individual  battle  or  for  the  cumulative  test  program.  Access  was  also  used  to  provide  preliminary  marking  of  records  each 
test  measure  for  analysis.  This  relational  database  with  marked  records  was  imported  into  SPSS,  a  statistical  analysis 
package,  for  more  detailed  descriptive  analysis,  ANOVA  analysis,  and  sensitivity  studies.  Automation  and  macros  were  also 
used  in  the  SPSS  programs  to  reduce  development  and  analysis  time. 

Embedded  Simulation  System  for  SMART 

Paul  Bounker 

TACOM,  AMSTA-TR-R,  MS  264, 

11  Mile  Rd. 

Warren,  MI  48093-5000 
(586)  574-5297,  Fax:  (586)  574-5008 
bounkep@tacom.armv.mil 

The  U.S.  Army’s  Tank- Automotive  Research,  Development  and  Engineering  Center  (TARDEC)  Embedded 
Simulation  (ES)  team,  has  developed  an  Embedded  Simulation  System  that  interfaces  with  advanced  vehicle  hardware 
and  software  as  part  of  the  Inter-Vehicle  Electronics  Suite  (IVES)  Science  and  Technology  Objective  (STO).  The  ES 
system  allowed  the  IVES  STO  to  field  test  advanced  concepts  such  as  Indirect  Vision  Driving,  Drive-By-Wire,  Voice 
Recognition,  3D  Audio,  Head  Tracking  and  advanced  crew  station  design  using  simulation  to  provide  stimulation  to 
crewmen.  Technologies  that  were  simulated  to  provide  workload  analysis  for  the  two-  man  crew  included  Automatic 
Target  Recognition  (ATR),  Automatic  Target  Tracking  (ATT),  C2,  integrated  OPFOR  and  Friendly  CGF  and 
Battlefield  Visualization. 
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A  Novel  Approach  to  Agent-Based  Modeling:  Patterns  and  Behaviors  as  Building  Blocks 

Dorian  Buitraqo 

The  Aerospace  Corporation 
2350  E.  El  Segundo  Bl. 

El  Segundo,  CA  90245-4691 

(310)  336-1132,  Fax:  (310)  336-0536 

dorian.v.buitrago@aero.org 

In  the  past,  the  art  of  combat  modeling  and  military  utility  analysis  has  been  plagued  by  three  persistent  factors:  1)  there 
is  no  "unifying  theory  of  combat"  to  support  a  first  principles  approach  to  warfare  modeling;  2)  there  are  no  validated  conops, 
tactics,  strategies  for  future  systems  operating  in  hypothetical  scenarios;  and  3)  general-purpose  systems  modeling  languages 
do  not  adequately  capture  spatial-temporal  interdependencies  and  nonlinear  processes  inherent  in  warfare.  Symptoms  of  this 
problem  include  proliferation  of  combat  system  MOPs/MOEs/MOOs/MOUs,  obscure  cause-and-effect  mechanisms 
embedded  within  large  and  complex  simulations,  and  oversimplification  of  system  models  in  order  to  fit  the  tools  on  hand. 
This  presentation  introduces  the  General  Agent  Interaction  Model  (GAIM),  a  modeling  paradigm  meant  to  address  these 
deficiencies,  and  its  prototype  implementation,  AgentSIM,  written  in  the  Mathematica©  programming  language.  GAIM 
provides  a  conceptual  framework  for  constructing,  evaluating,  and  analyzing  agent-based  models  in  terms  of  standardized 
behavioral  components  and  agent-target  interactions.  AgentSIM  provides  an  integrated  environment  for  documenting,  coding, 
executing,  and  presenting  small-scale  GAIM  applications  using  Mathematica' s©  symbolic  programming  and  notebook 
interface  technologies.  The  principles  of  modularity,  flexibility,  and  traceability  inherent  in  the  GAIMJAgentSIM  approach  to 
modeling  are  illustrated  in  the  context  of  a  notional  SEAD  mission  analysis  template. 


Teaching  Strategic  Center  of  Gravity  Analysis  Through  Learning  Agent  Technologies 


William  H.  Cleckner 

Center  for  Strategic  Leadership 
650  Wright  Avenue 
Carlisle  Barracks,  PA  17013 
(717)  245-4027 
Fax:  (717)  245-4600 
william.cleckner@csl.carlisle.armv.mil 


Gheorghe  Tecuci 
George  Mason  University 
4400  University  Dr 
Fairfax,  VA  22030 
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tecuci@gmu.edu 


Jerry  Comello 
U.S.  Army  War  College 
122  Forbes  Avenue 
Carlisle  Barracks,  PA  17013 
(717)  245-3498 

ierome.comello@carlisle.armv.mil 


Students  at  the  U.  S.  Army  War  College  are  discovering  new  insights  into  Center  of  Gravity  analysis.  They  both  teach 
and  learn  from  an  intelligent  agent  software  program  called  Disciple,  created  in  the  George  Mason  University  Learning 
Agents  Laboratory  (LALAB).  This  paper  will  describe  a  multi-faceted  research  and  development  effort  that  synergistically 
integrates  research  in  Artificial  Intelligence,  Center  of  Gravity  analysis,  and  practical  deployment  of  an  agent  into  Education. 

A  Hybrid  Tabu  Search/Set  Partitioning  Approach  to  Tanker  Crew  Scheduling 

Capt  Todd  E.  Combs  Dr.  James  T.  Moore 

AFIT/ENS  AFIT/ENS 

2950  P  St  2950  P  St 

Wright-Patterson  AFB,  OH  45433  Wright-Patterson  AFB,  OH  45433 

(937)  255-6565  x4308  (937)  255-6565  x4337 

Fax:  (937)  656-4943  Fax:  (937)  656-4943 

todd.combs@afit.edu  iames.moore@afit.edu 

Aerial  refueling  is  a  crucial  component  of  modern  day  operations.  A  vital  part  of  this  refueling  process  is  the  individual 
tanker  crews.  Constrained  by  the  number  of  crews  available,  the  USAF  must  find  ways  to  schedule  them  efficiently. 

This  paper  details  solving  the  tanker  crew  scheduling  problem  with  a  hybrid  tabu  search/set  partitioning  optimizer.  We 
show  the  synergistic  use  of  the  two  approaches.  The  tabu  search  metaheuristic  acts  as  a  column  generator  for  the  set 
partitioning  optimizer,  while  the  set  partitioning  optimizer  provides  a  vocabulary  building  mechanism  for  the  tabu  search. 

We  show  how  the  model  may  be  used  as  an  analytical  tool,  as  well  as  an  operational  scheduler.  Statistical  results  show 
the  increased  performance  of  the  hybrid  over  the  existing  USAF  tool  and  the  tabu  search  working  alone.  The  results  also 
show  how  problem  characteristics  affect  the  solution  process. 
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Analytic  Support  for  Courses  of  Action  Development  During  Crisis  Action  Planning 

Kevin  Denham 

Joint  Warfighting  Center  Support  Team 

1 16  Lake  View  Parkway 

Suffolk,  VA  23435-2697 

(757)  686-7707,  Fax:  (757)  686-7078 

denham@iwfc.ifcom.mil 

US  Joint  Forces  Command  Joint  Warfighting  Center  (USJFCOM  JWFC)  is  working  to  improve  Courses  of  Action 
(CO A)  analysis  and  use  of  staff  planning  tools  during  crisis  action  planning  (CAP).  To  maintain  relevancy  in  current  and 
future  crisis  responses,  Joint  Task  Force  (JTF)  planners  must  be  able  to  consider  not  only  the  traditional  military  actions  to 
achieve  strategic  and  operational  objectives,  but  they  must  also  analyze  other  elements  of  power  (diplomacy,  information, 
and  economic)  and  consider  their  interactions.  Modern  Crisis  Action  Planning  requires  JTF  staffs  to  conduct  multiple 
detailed  analyses  of  greater  complexity  in  ever-shortening  timelines.  The  majority  of  current  models,  simulations,  and 
automated  decision  aids  currently  fielded  do  not  adequately  support  course  of  action  analysis  during  CAP  at  the  joint 
operational  level  of  war.  They  tend  to  be  tactical,  service-centric,  attrition-based,  force-on-force  systems  that  fail  to  capture 
contemporary  crisis  dynamics.  There  is  an  immediate  need  for  analytic  tools  to  support  crisis  action  planning  courses  of 
action  development  and  selection  at  the  operational  level. 


Combat  Scenario  Development  and  Gaming  Level  Editing:  A  Comparison  of  Procedures 
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The  development  of  scenarios  for  combat  models  and  the  creation  of  levels  (the  gaming  term  for  scenarios)  for  the 
civilian  gaming  community  are  very  similar  activities  yet  they  differ  significantly  in  terms  of  purpose  and  procedures.  These 
differences  have  produced  two  similar  product  development  techniques,  each  evolving  somewhat  independently  over  the  last 
thirty  years.  These  processes  provide  significant  overlapping  functionality  yet  each  has  specific  strengths  and  limitations. 
After  analyzing  the  methods  of  combat  model  scenario  development  and  gaming  level  creation  for  three  state  of  the  art  and 
emergent  models,  we  compare  and  contrast  the  current  state-of-  the-art  in  these  communities,  with  the  objective  of 
identifying  potential  areas  for  enhancing  each  procedure  by  exploiting  the  advantages  of  the  other.  Harvesting  some  of  these 
capabilities  from  the  gaming  community  could  help  to  reduce  combat  model  scenario  development  time  and  improve 
modelers’  abilities  to  demonstrate  scenarios  to  the  chain  of  command. 


Assessing  Effects  of  Enhanced  Fidelity  for  Ground  Vehicle  Mobility  in  Combat  Models 
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As  computer  systems  exhibit  greater  computing  power,  they  provide  combat  model  developers  the  capabilities  to 
enhance  the  fidelity  of  their  simulations  by  improving  the  fidelity  of  underlying  algorithms.  Movement,  such  as  ground 
vehicle  movement,  is  one  of  the  basic  battlefield  functions  and  is  portrayed  at  differing  levels  of  fidelity  across  M&S. 
Ground  vehicle  movement  is  limited  by  the  terrain/environmental  factors  present  in  reality,  but  this  fact  is  not  necessarily 
reflected  in  current  simulations.  The  need  to  account  for  such  effects  has  been  acknowledged  by  the  community  and  is  being 
incorporated  in  developing  simulations.  As  simulation  fidelity  is  enhanced,  however,  it  is  also  important  to  address  the 
question  of  what  increased  or  decreased  fidelity  representation  buys  the  user/analyst. 

This  paper  will  address  effects  of  improving  ground  vehicle  mobility  representation  in  entity-level  M&S  by 
incorporating  mobility  limiters,  utilizing  the  recent  integration  of  the  standard  mobility  application  programmers  interface, 
STNDMob  API,  with  COMBATXXI.  The  development  and  integration  were  conducted  largely  by  the  US  Army  Engineer 
Research  and  Development  Center  and  the  US  Army  TRADOC  Analysis  Center  -  White  Sands  Missile  Range. 
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COMBATXXI  is  the  Army’s  next-generation  brigade  and  below  entity  level  analytical  model.  The  standard  mobility 
application  programmers  interface,  STNDMob  API,  allows  entity  level  models  to  use  terrain  limited  speed  factors  and  is 
based  on  the  Army’s  standard  mobility  model,  NATO  Reference  Mobility  Model  (NRMM).  This  integration  has  revealed 
some  potential  impacts  on  simulation  outcomes  resulting  from  dynamically  limiting  the  speed  of  vehicles  and  restricting 
areas  of  operation  based  on  environmental  conditions  versus  utilizing  command  ordered  or  static  speeds  and  will  form  the 
basis  for  the  study. 


Resampling  Statistics  and  Designed  Experiments 
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For  those  of  us  that  teach  statistics,  one  result  is  clear:  most  people  find  the  subject  difficult  and  confusing,  leading  to 
either  failing  to  apply  the  correct  methods  in  real  world  problems  or  failing  to  apply  statistics  at  all.  Dr.  Julian  Simon,  a 
founding  father  in  the  field  of  Resampling  Statistics  (1967),  believes  that  the  inherent  difficulty  in  statistics  lies  in  the 
difficulty  of  the  concepts  addressed. 

Dr.  Bradley  Efron,  of  Stanford  University,  independently  developed  a  general  resampling  method  he  called  the 
’’bootstrap",  in  the  1970s.  The  basic  idea  is  that  all  the  information  we  have  about  a  sample  is  contained  in  that  sample;  we 
have  no  a  priori  knowledge  that  the  sample  came  from  a  specific  type  of  distribution.  Since  that’s  true,  let’s  treat  the  sample 
as  the  proxy  universe  that  all  samples  come  from.  Everything  else  in  bootstrap  follows  from  that  simple  idea.  Jerome  H. 
Friedman,  a  Stanford  resampling  statistician  said:  “Eventually,  it  will  take  over  the  field,  I  think.'"  ( New  York  Times ,  Nov.  8, 
1988,  Cl,  C6) 

We  are  in  the  process  of  determining  whether  Dr.  Friedman  is  correct.  Design  of  Experiments  has  revolutionized  testing 
at  the  53rd  Wing,  Eglin  AFB,  but  we  continue  to  struggle  with  generating  enough  practitioners  of  the  method  to  address  all 
the  tests  undertaken  by  the  Wing.  The  chief  difficulty  lies  in  teaching  the  foundations,  mechanics  and  extensions  of  the 
Analysis  of  Variance  (ANOVA)  to  analyze  the  sample  (now  2-3  weeks).  This  paper  represents  a  status  report  on  a  work  in 
progress  -  determining  how  the  attractive  aspects  of  resampling  statistics  can  be  applied  to  the  multivariate  problems  of 
experimental  design.  We  will  summarize  the  background  of  resampling  statistics,  and  the  classical  and  resampling 
approaches  to  analyzing  multivariate  data. 


Sample  Size  Estimation  Using  Bootstrap 
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One  typically  needs  an  estimate  of  how  many  samples  should  be  collected,  even  before  a  test  starts.  Sample  size 
calculations  for  factorial  tests  typically  make  distribution  assumptions  that  may  not  be  warranted.  We  will  approach  sample 
size  calculation  using  bootstrap,  a  distribution-free  technique,  and  compare  it  to  more  common  approaches. 


Using  Resampling  for  Design  of  Experiments  With  Missing  Data 
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The  usual  approach  to  missing  data  in  factorial  experiments  is  to  estimate  the  level  of  the  missing  treatment  by  fitting  a 
model  to  the  existing  data  and  using  this  calculated  value  as  a  surrogate.  Here,  we  show  an  alternative  using  resampling.  We 
compare  the  two  approaches  and  discuss  the  differences. 
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An  Integrated  Gaming  System  for  the  Army  Transformation  Wargame 
Mr.  Eric  Johnson 
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The  Integrated  Gaming  System  (IGS)  is  an  integrated,  model-supported  gaming  system  consisting  of  a  set  of  tools  linked 
to  a  common  database  and  capable  of  supporting  a  wide  range  of  gaming  requirements.  The  U.S.  Army  Training  and 
Doctrine  Command  (TRADOC)  Analysis  Center  (TRAC)  provides  contract  oversight  management  for  the  development  and 
use  of  the  IGS  in  support  of  the  TRADOC  Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  The  Wargaming  and  Futures 
Directorates  within  DCSDOC  are  the  program  and  systems’  sponsors. 

The  IGS  is  a  Booz-Allen  &  Hamilton  (BAH)-developed  wargame  automation  system  that  fulfills  the  functional 
requirements  of  the  Wargame  Architecture  (WGA)  concept,  which  developed  out  of  requirements  identified  by  DCSDOC 
beginning  in  1996.  DCSDOC  identified  these  requirements  while  preparing  for  a  series  of  wargaming  events  that  supported 
the  Army  After  Next  (AAN)  future  studies  effort.  The  purpose  of  the  IGS  is  to  perform  the  functions  of  the  WGA  in  support 
of  TRADOC’s  Army  Transformation  wargame,  study,  and  research  efforts.  This  presentation  provides  an  overview  of  the 
IGS  system,  its  components,  and  its  use  during  last  year's  Army  Transformation  Wargame  -  Vigilant  Warriors  01. 

An  Application  of  Distillation  Modeling  to  Studying  the  Enemy  Within 

Sarah  Johnson  Matthew  T.K.  Koehler 

The  MITRE  Corporation  Center  for  Army  Analysis 
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Ongoing  research  into  how  to  develop  better  maneuver  warriors  through  the  application  of  distillation  modeling  and  data 
farming  to  questions  regarding  conflict  is  sponsored  by  the  USMC’s  Project  Albert.  MITRE  is  supporting  Project  Albert’s 
effort  to  develop  tools  to  explore  questions  using  a  synthesis  of  both  new  and  existing  methods.  The  approach  is  to  use  a 
series  of  new  models/analytic  tools,  multi-disciplinary  teams,  and  the  scientific  method  to  explore  questions;  exploit 
advances  in  computing  power  and  visualization  tools;  and  utilize  the  meta- technique  of  “Data  Farming’’  to  go  beyond  single 
point  estimate  and  look  at  questions  from  the  perspective  of  many  data  points.  This  presentation  describes  a  set  of  recent 
applications  addressing  questions  relating  to  "the  threat  within"  including  martyr-minded  enemies,  sabotage  and  corruption, 
incompetence,  and  false  intelligence.  A  demonstration  of  the  distillation  tools  employed  in  this  research  as  well  as  data 
associated  with  this  study  will  be  discussed. 

Standard  Nomenclature  Database  &  Website 

Robert  H.  “Pete”  Kaedina 
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255  Sedgwick  Ave,  Ft.  Leavenworth,  KS,  66027 

(913)  684-9161,  Fax:  (913)  684-9288,  kaedingr@trac.armv.mil 

Approximately  11  years  ago  the  TRADOC  Analysis  Center  (TRAC)  took  the  initiative  to  develop  a  "standard 
nomenclature  library/dictionary"  to  facilitate  the  exchange  of  characteristics  &  performance  (C&P)  data  with  our  customers 
and  data  providers.  This  "weapon  system"  C&P  data  is  required  to  feed  TRAC  combat  simulations  run  in  support  of  TRAC 
studies.  TRAC  stores  this  C&P  data  in  Functional  Area  Databases  where  it  is  indexed  by  the  "standard  component  names" 
(e.g.,  platform,  weapon,  mount,  munition,  etc.).  These  standard  names  are  stored  in  the  TRAC  developed  Standard 
Nomenclature  Database  (SND).  Previously  inconsistencies  in  these  component  names  like  T-72,  T72,  T/72  or  T  72  severely 
complicated  the  "electronic"  exchange  of  data.  Since  TRAC  does  not  have  the  manpower  or  diverse  expertise  to  solely 
maintain  the  ever-growing  SND,  help  is  solicited  via  the  TRAC  (SIPRNet)  website  which  went  into  operation  in  August 
1999.  Registered  website  customers  are  encouraged  to  recommend  nomenclature  additions,  deletions  and  modifications  in 
areas  of  personal  expertise.  TRAC,  AMSAA,  NGIC  and  CAA  are  working  toward  nomenclature  compliance  within  their 
respective  C&P  databases  and  it  is  anticipated  that  sometime  in  the  future  AMSAA  will  assume  responsibility  for  the  SND 
and  supporting  website,  but  currently  it  remains  under  TRAC  control.  My  presentation  will  also  briefly  touch  on  our 
Functional  Area  Databases  and  a  couple  of  downloadable  software  applications  (most  notably  the  TRAC  Automated  Data 
Request  System;  TRACDRS)  our  customers  use  to  submit  consistently  formatted,  standard  nomenclature-compliant  data 
requests. 
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An  Agent-Based  Modeling  Approach  to  Measuring  the  Value  of  a  Proposed  Information  System 
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(913)  680-0050 
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For  several  years  the  U.S.  Army  and  Department  of  Defense  have  struggled  with  how  to  measure  the  value  of  battlefield 
information.  Digital  information  systems  have  demonstrated  the  potential  to  significantly  increase  the  combat  effectiveness 
of  our  forces,  but  in  order  to  make  procurement,  force  structure,  and  basis  of  issue  decisions,  we  would  like  to  gauge  the 
extent  to  which  these  systems  increase  combat  effectiveness.  This  paper  describes  a  methodology  we  chose  to  investigate 
whether  an  agent-based-model  (ABM)  could  be  used  to  suggest  appropriate  behaviors  for  a  combat  force  equipped  with  a 
proposed  information  system  such  as  Future  Battle  Command  Brigade  and  Below  -  FBCB2.  The  decision  agents  within  the 
model  will  use  the  information  about  enemy  forces,  friendly  forces,  and  terrain  provided  by  the  proposed  information  system 
to  adjust  the  friendly  course  of  action  to  the  updated  situation.  Our  methodology  is  a  three-step  process.  We  first  execute 
simulation  runs  using  an  existing  dynamic  study  scenario  and  evaluate  the  results  of  these  runs.  In  the  second  step,  we 
transfer  the  terrain,  units,  and  course  of  action  from  the  existing  dynamic  scenario  to  an  ABM  with  intelligent  agents  that  will 
refine  the  course  of  action  genetic  algorithm  by  generating  new  unit  positions  and  routes  based  upon  the  current  situation.  In 
the  final  step,  we  substitute  the  ABM  developed  course  of  action  and  behaviors  back  into  the  dynamic  study  scenario  and 
execute  another  set  of  simulation  runs.  The  performance  of  the  friendly  force  using  the  proposed  information  system  and 
ABM  generated  behaviors  may  be  compared  to  the  performance  of  the  friendly  force  which  failed  to  take  advantage  of 
current  information.  This  gives  insight  into  the  potential  increase  in  combat  effectiveness  realized  through  the  use  of  an 
information  system. 
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The  events  of  1 1  September  will  profoundly  affect  military  affairs,  at  every  level  from  strategic  to  operational  to  tactical. 
The  fact  is,  all  activities  in  a  healthy  military — including  tactics,  doctrine,  weapons  acquisition,  joint  operations,  intelligence, 
and  combat  support — should  be  in  a  constant  state  of  positive  change.  That  is  because  the  factors  that  affect  military  affairs 
are  in  a  constant  state  of  flux.  These  factors  include  changes  in  the  threat’s  tactics  and  weapons,  changes  in  the  arenas  in 
which  we  employ,  and  the  emergence  of  new  technologies  creating  potentially  new  capabilities  in  our  weaponry.  History,  in 
fact,  has  shown  that  a  failure  to  accommodate  changes  in  the  threat,  the  environment,  and  new  technology  leads  to  disastrous 
results  in  combat. 

The  emergence  of  a  new  level  of  international  terrorism,  especially  as  a  direct  and  significant  threat  to  the  security  of  the 
continental  US,  is  a  perfect  illustration  of  a  factor  that  will  demand  changes  in  military  tactics,  doctrine,  and  weaponry.  We 
should  expect  to  see,  therefore,  changes  in  strategy,  operational  doctrine,  tactics,  and  weapons  over  the  near  future.  We  may 
also  see  an  increase  in  the  funding  for  these  endeavors.  However,  we  can  be  sure  that  in  any  case,  resources  for  testing  will 
always  be  constrained.  There  will  always  be  a  need  for  efficient  as  well  as  effective  testing. 

All  of  the  services  have  well  established  processes  in  place  to  develop  new  tactics  in  response  to  changes  in  the  threat, 
the  arena,  and  the  available  technology.  In  the  Air  Force,  this  process  is  most  obvious  during  Tactics  Development  and 
Evaluations,  or  TD&Es.  This  form  of  operational  testing  typically  involves  operationally  representative  US  platforms, 
employed  by  combat  qualified  crews,  in  realistic  exercises,  against  representative  live  threats,  capitalizing  on  digital 
computation  for  range  support  and  weapon  simulations.  In  fact,  these  exercises  are  run  as  close  to  combat  realism  as 
possible.  For  air-to-surface  tactics,  live  ordnance  is  often  employed.  For  air-to-air  tactics,  computer  simulations  substitute 
for  live  missiles  and  guns.  Various  tactics  are  proposed  and  then  flown  in  these  realistic  scenarios.  Results  are  collected  in 
the  form  of  both  objective,  quantitative  data  and  subjective  evaluations  from  the  participants.  Because  the  exercises  are  quite 
complex  and  involve  many  players  and  a  large  number  of  variables  (some  controllable,  some  not)  affecting  the  outcome,  and 
because  the  usefulness  of  tactics  is  often  more  opinion  than  fact,  we  have  typically  relied  heavily  upon  the  subjective  post¬ 
mission  assessments  of  the  participants,  and  less  on  objective,  quantitative  analysis. 

The  use  of  Design  of  Experiment  (DOE)  as  a  methodology  for  setting  up  tests  and  evaluating  the  results  has  been 
essentially  non-existent  within  Air  Force  tactics  development.  Even  when  offered  to  test  managers,  arguments  against  the 
use  of  DOE  are  many:  DOE  will  overly  constrain  the  participants  in  realistic,  operational  testing;  the  scenarios  are  overly 
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complex  for  DOE;  tactics  are  not  suitable  for  numerical  analysis;  DOE  demands  too  many  resources.  Recently,  there  has 
been  a  movement  within  the  Air  Force  to  utilize  DOE  during  operational  testing,  though  significant  resistance  remains. 

The  truth  is,  DOE  has  been  used  for  many  years  on  very  complex  experiments  in  the  civilian  sector.  Its  application  to 
military  experiments,  including  TD&Es,  is  clearly  apparent.  In  fact,  it  is  during  the  most  complex  kinds  of  experimentation, 
like  tactics  development,  where  DOE  has  the  greatest  potential  to  deliver  more  and  better  knowledge  about  the  phenomena 
occurring,  to  provide  quality  answers  using  fewer  resources,  or  to  yield  more  information  for  the  same  resources. 
Nevertheless,  we  still  face  the  same  arguments. 

The  purpose  of  this  study  was  to  demonstrate  the  utility  of  DOE  in  the  tactics  development  arena  in  order  to  dispel  the 
myths  that  DOE  is  either  impractical  or  ineffective.  The  study  included  both  experimental  design  (for  example,  the  use  of 
factorial  experiments,  randomization,  independent  trials)  and  analysis  (the  use  of  ANOVA).  The  study  utilized  a  Microsoft 
Excel-based  simulation  of  aerial  combat — a  relatively  simple,  but  nevertheless  high  fidelity  model  of  aerial  combat 
engagements  involving  as  many  as  8  versus  8  players,  using  notional  but  realistic  event  probabilities  obtained  from  subject 
matter  experts.  The  model  includes  such  events  as  threat  detection,  hostile  declaration,  and  effective  missile  employment. 
After  a  significant  amount  of  verification  using  subject  matter  expertise,  the  model  was  given  favorable  reviews.  We  then  set 
up  a  notional  tactics  development  evaluation,  with  a  number  of  control  factors  typical  of  TD&Es  (threat  electronic  warfare, 
friendly  support  assets,  threat  tactics  options,  and  friendly  rules  of  engagement)  to  assess  two  notional  friendly  tactics 
(Option  A  and  Option  B).  Our  response  variables  included  such  typical  air-to-air  success  measures  as  kill  ratios,  threats 
killed,  and  friendlies  lost. 

The  study  used  a  series  of  engagement  simulations  to  compare  the  results  obtained  using  sound  DOE  principles  against 
the  most  typical  methodologies  currently  used:  “one-factor-at-a-time”  and  “best  guess.”  The  study  demonstrated  the 
shortcomings  of  these  techniques  in  comparison  with  both  the  efficiency  and  the  effectiveness  of  results  obtained  through 
DOE. 

By  using  an  inexpensive,  simple,  but  high  fidelity  simulation  of  aerial  combat,  we  were  able  to  demonstrate  the  value  of 
DOE  in  the  complex  arena  of  tactics  development.  The  fact  is  that  in  any  tactics  exercise,  there  are  always  constraints  placed 
on  the  participants,  generally  in  the  control  factors  that  we  chose  for  our  model  (rules  of  engagement,  friendly  support,  threat 
tactics,  and  so  on).  We  have  demonstrated  that  is  possible  to  control  the  engagements  at  the  scenario  level,  without 
constraining  the  maneuvering  and  tactical  decisions  of  the  participants.  Using  the  scenario-level  elements  as  our  control 
factors,  and  by  assessing  results  using  traditional  measures  of  effectiveness,  we  were  able  to  demonstrate  the  utility  of  DOE 
in  spite  of  the  complexity  of  the  experiment,  thereby  countering  the  traditional  arguments  against  DOE.  DOE  was  clearly 
able  to  provide  more  and  better  knowledge  about  the  relationships  between  the  control  variables — especially  the  friendly 
tactics  option — and  the  response  variables,  while  using  fewer  trials  that  expend  valuable  test  resources. 

The  result  of  this  study  is  a  method  of  demonstrating  the  utility  of  DOE  during  the  most  complex  of  tests,  as  the  Air 
Force  embarks  on  a  program  to  make  it  the  methodology  of  choice  for  all  Air  Force  testing. 


AMSAA  Infantry  MOUT  Simulation  (AIMS) 
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AMSAA  is  developing  the  AMSAA  Infantry  MOUT  Simulation  (AIMS)  to  support  Army  analysis  on  evaluating 
infantry  soldier/unit  performance  in  a  MOUT  environment.  This  modeling  effort  is  designed  to  fill  a  key  Army  MOUT 
modeling  and  analysis  void.  Key  to  the  AIMS  development  is  designing  the  soldier/unit  MOUT  behavior.  The  effort  is 
state-of-the-art  in  its  use  of  object-oriented  programming  using  the  Joint  Model  and  Simulation  System  (JMASS).  This 
project  will  involve  development  of  individual  soldier  behaviors  and  activities  as  well  as  his  function  as  part  of  a  unit  when 
carrying  out  missions  and  tasks  using  the  various  weapons  and  equipment  assigned  to  him.  AIMS  is  being  designed  to 
simulate  soldier  behaviors  to  respond  to  the  following  scenario  conditions: 


-  Ambush/counter-ambush 
Sniper/counter-sniper 
Preparation/penetration  of  obstacles 

-  Employing  support  Fire 


Defending  sector 
Defeat/neutralize  attack 
Containment  of  prisoners 
Evacuation  of  wounded 


AIMS  is  undergoing  a  proof-of-principle  study  to  support  simulation  VV&A.  It  is  envisioned  that  AIMS  will  become 
the  basis  for  the  Army’s  item- level  and  small  unit  engagement  analyses  to  support  requirements  generation,  materiel 
evaluation,  and  Analysis  of  Alternative  studies. 
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The  robustness  of  training  simulations  continues  to  skyrocket  as  the  power  of  computers  drastically  increases  in 
accordance  with  Moore’s  Law.  Without  being  careful  though,  extra  burdens  demanded  by  trainers  in  behavior  and  fidelity 
will  slow  execution  times  to  an  unacceptable  level.  Computer-based  simulations,  such  as  the  WARfighters’  SIMulation 
(WARSIM),  represent  systems  and  forces  built  from  a  complex  and  functional  description  of  military  land  warfare.  The 
computerized  battlespace  that  WARSIM  model  for  training  joint,  corps  and  divisional  commanders  and  their  staffs  can 
become  unwieldy  in  size  and  functionality.  Functionality  is  key,  but  next  comes  performance  of  the  simulation  as  it  portrays 
combat  and  its  related  behaviors,  environments  and  functions.  One  must  assess  the  performance  of  the  large-scale  simulation 
to  determine  and  justify  the  appropriate  suite  of  fielded  hardware,  software  and  network.  Logistical  support  personnel  and 
training  site  coordinators  need  to  know  whether  newly-built  and  equipped  simulation  centers  will  adequately  handle  the  size 
of  a  specific  training  scenario.  Proactive  efforts  to  analyze  and  predict  the  processes  and  associated  impacts  on  performance 
are  critical.  Using  a  performance  prediction  model,  the  analytical  results  may  help  reduce  time,  resources,  and  risks 
associated  with  the  processes  of  the  training  system  being  acquired.  The  WARSIM  Performance  Emulation  Model  shows 
and  predicts  how  a  training  simulation  will  perform.  The  results  from  the  findings  help  guide  the  development  of  the  actual 
WARSIM  system  components.  This  paper  describes  the  use  of  a  commercial  off-the-shelf  simulation  package  to  emulate 
WARSIM  and  discusses  the  potential  application  to  other  simulation  models  for  applying  analytical  tools  that  predict 
performance. 
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Obstacles  can  disrupt,  impede,  and  otherwise  influence  the  outcome  of  military  operations,  understanding  when  and  how 
fast  an  obstacle  can  be  crossed  is  required  to  increase  Army  model  and  simulation  fidelity.  Obstacles  other  than  minefields, 
such  as  ditches,  berms,  cuts  and  fills,  craters,  etc  can  be  either  natural,  man  made  or  reinforced,  and  depending  on  vehicle 
capabilities,  these  obstacles  may  be  crossable,  but  at  a  greatly  reduced  speed.  Obstacle  crossing  speed  is  also  an  issue  when 
comparing  performance  between  wheel  and  tracked  vehicles,  additionally  the  performance  of  small  robotic  vehicles  must 
also  be  considered  in  emerging  simulations.  This  presentation  describes  current  efforts  by  the  Engineer  Research  and 
Development  Center  (ERDC)  to  enhance  vehicle  speed  predictions  during  an  obstacle  crossing  in  a  SAF  environment. 

The  NATO  Reference  Mobility  Model  II  (NRMM  II)  is  an  Army  standard  model  for  determining  vehicle  mobility 
performance,  primarily  by  predicting  maximum  vehicle  capable  speeds.  The  effect  of  a  linear  obstacle  on  maximum  speed  is 
determined  by  using  two  look-up  tables.  The  first  is  a  table  of  average  and  maximum  (resistance  to  motion)  forces  and 
minimum  clearances  based  on  standard  obstacle  descriptions.  If  the  minimum  clearance  is  greater  than  the  vehicle  clearance, 
the  maximum  force  is  used  to  determine  if  there  is  enough  available  traction  to  cross  the  obstacle.  If  either  the  clearance  or 
maximum  traction  tests  fail,  NRMM  II  predicts  no-go.  Otherwise,  the  average  force  is  added  to  the  total  resistance,  which  is 
used  to  calculate  the  maximum  vehicle  capable  speed  across  the  obstacle.  The  second  table  contains  vehicle  speed  versus 
obstacle  height  and  is  used  to  limit  speed  due  to  vehicle  and  driver  acceleration  tolerance  (2.5g).  These  tables  are  in  the 
individual  NRMM  II  vehicle  data  files,  and  are  produced  using  2-dimensional  vehicle  dynamics  software  (OBSMOD  and 
VEHDYN  II). 

The  extraction  of  this  information,  obstacle  description  requirements,  the  implementation  of  this  high  resolution 
data/model  into  a  lower  resolution  SAF  environment  are  discussed. 

The  ES  system  has  also  been  integrated  with  AMC  RDEC  Federation.  The  RDEC  Federation  provides  full  spectrum 
modeling  and  simulation  services  to  any  customer.  Full  spectrum  ranges  from  engineering  level  models  through  virtual 
prototypes  onto  battlefield  simulations.  All  models  are  validated  to  the  system  they  represent  through  close  interaction 
between  the  modeler  and  system  developer.  All  simulation  scenarios  are  based  upon  realistic  circumstances,  run  real-time, 
and  generate  semi-automated  forces  as  required.  Each  RDEC  (and  ARL  and  STRICOM)  brings  a  robust  suite  of  supported 
models  within  their  area  of  technological  and  subject  matter  expertise.  These  areas  include  mobility,  missiles,  armaments, 
communications,  aviation,  target  acquisition  sensors,  survivability,  vehicles,  and  command  and  control.  By,  utilizing 
environment  servers  provided  by  the  Joint  Virtual  Battlespace  (JVB)  environmental  conditions  would  be  able  to  be  used  to 
provide  realistic  testing  of  the  above  models.  The  use  of  ES  System  allows  the  customer  to  evaluate  advanced  concepts  in 
the  latest  crewstation  designs  with  the  latest  interfaces. 

The  ES  system  is  being  enhanced  and  used  as  part  of  the  Crew  integration  and  Automation  Testbed  (CAT)  Advanced 
Technology  Demonstration  (ATD)  and  Robotic  Follower  ATD  in  support  of  the  FCS  program.  A  field  demonstration  is 
planned  for  2003. 
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The  future  of  the  military  is  relying  on  Commercial  off  the  Shelf  (COTS)  products  to  address  real  time  military 
requirements.  These  computing  challenges  within  the  Navy  were  one  of  the  motivating  factors  for  the  creation  of  the  High 
Performance  Distributed  Computing  (HiPer-D)  prototyping  effort.  The  High  Performance  Distributed  Computing  (HiPer-D) 
laboratory  is  a  real-time  laboratory  located  in  Dahlgren  Virginia  where  multiple  Aegis  tactical  system  platforms  are 
prototyped  in  order  to  demonstrate  proofs  of  concepts  with  respect  to  advanced  computing  architecture  and  algorithm 
development  using  COTS  technologies.  The  focus  of  this  brief  is  to  describe  the  advantages  and  lessons  learned  of  utilizing 
middleware  such  as  Ensemble  and  Network  Data  Delivery  Service  (NDDS)  which  allows  code  portability,  open  architecture 
design  and  risk  reduction  of  extraneous  errors.  The  example  that  will  be  used  to  demonstrate  the  advantages  of  the  non- 
intrusive  nature  and  portability  of  object  code  will  be  the  integration  of  an  Engagement  Coordination  scheme  that 
communicates  with  each  platform’s  Weapon  Control  System  (WCS). 
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We  present  a  methodology  using  existing  tools  from  Project  Albert  to  analyze  counter  terrorism  (CT).  Project  Albert  is  a 
research  and  development  effort  of  the  Marine  Corps  Combat  Development  Command  (MCCDC)  to  assess  the  general 
applicability  of  the  study  of  complex  adaptive  systems  (CAS)  to  warfare,  and  to  provide  new  methodologies  for  investigating 
the  results  of  running  such  models,  and  incorporating  those  results  with  other,  more  traditional,  methods  of  analysis.  Two 
Project  Albert  tools  used  in  this  CT  analysis  are  Socrates,  an  agent-based  model,  together  with  a  Generative  Analysis  (GAn) 
search  heuristic. 

Our  analysis  frames  CT  questions  to  be  answered  and  poses  candidate  issues  to  counter  terrorism.  We  examine  terrorist 
behaviors  and  personalities  modeled  in  Socrates  and  address  the  relationships  among  Red,  Blue,  and  other  agents.  The  GAn 
search  heuristic  starts  by  generating  a  set  of  possible  solutions.  These  solutions  are  then  evaluated  by  Socrates.  The  best 
solutions  with  respect  to  desired  “effects’*  are  saved.  The  next  set  of  trial  solutions  is  then  generated  and  the  process  is 
repeated. 

We  apply  EBO  to  select  the  “best  of  the  best’’  from  the  set  of  best  solutions.  The  best  solutions  from  the  GAn  heuristic 
search  were  generated  trying  to  optimize  over  a  set  of  desired  effects  (or  goals).  Using  the  concept  of  EBO,  we  pick  from  the 
best  solutions  those  that  are  what  Dr.  Alfred  Brandstein  calls  “more  interesting’’  -  that  is,  they  are  more  robust,  or  achieve  the 
effect  in  some  novel  fashion.  Finally,  we  analyze  the  more  interesting  solutions  to  gain  insights  for  the  CT  mission,  e.g.,  find 
anti-solutions,  i.e.,  what  Red  comes  up  with  to  counter  Blue’s  best. 
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We  present  a  methodology  using  existing  tools  from  Project  Albert  to  analyze  counterterrorism  (CT).  Project  Albert  is  a 
research  and  development  effort  of  the  Marine  Corps  Combat  Development  Command  (MCCDC)  to  assess  the  general 
applicability  of  the  study  of  complex  adaptive  systems  (CAS)  to  warfare,  and  to  provide  new  methodologies  for  investigating 
the  results  of  running  such  models,  and  incorporating  those  results  with  other,  more  traditional,  methods  of  analysis.  Two 
Project  Albert  tools  used  in  this  CT  analysis  are  Socrates,  an  agent-based  model,  together  with  a  Generative  Analysis  (GAn) 
search  heuristic. 

Our  analysis  frames  CT  questions  to  be  answered  and  poses  candidate  issues  to  counter  terrorism.  We  examine  terrorist 
behaviors  and  personalities  modeled  in  Socrates  and  address  the  relationships  among  Red,  Blue,  and  other  agents.  The  GAn 
search  heuristic  starts  by  generating  a  set  of  possible  solutions.  These  solutions  are  then  evaluated  by  Socrates.  The  best 
solutions  with  respect  to  desired  "effects"  are  saved.  The  next  set  of  trial  solutions  is  then  generated  and  the  process  is 
repeated. 

We  apply  EBO  to  select  the  "best  of  the  best"  from  the  set  of  best  solutions.  The  best  solutions  from  the  GAn  heuristic 
search  were  generated  trying  to  optimize  over  a  set  of  desired  effects  (or  goals).  Using  the  concept  of  EBO,  we  pick  from  the 
best  solutions  those  that  are  what  Dr.  Alfred  Brandstein  calls  "more  interesting"  -  that  is,  they  are  more  robust,  or  achieve  the 
effect  in  some  novel  fashion.  Finally,  we  analyze  the  more  interesting  solutions  to  gain  insights  for  the  CT  mission,  e.g.,  find 
anti-solutions,  i.e.,  what  Red  comes  up  with  to  counter  Blue's  best. 
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Artificial  Warfare  is  the  practice  of  studying  the  art  of  war  using  computational  models  of  many  simple  interacting 
agents  following  well-defined  rules.  We  call  these  agent-based  simulations  distillations,  to  reflect  their  nature  as  extractions 
and  abstractions  of  the  essential  elements  of  warfare.  As  part  of  the  Marine  Corps'  Project  Albert,  we  have  developed  and 
sponsored  development  of  a  variety  of  distillations.  We  begin  by  describing  general  characteristics  of  distillations,  their 
relationship  to  other  tools  for  the  study  of  warfare,  and  then  discuss  several  of  the  distillations  that  are  openly  available.  We 
also  discuss,  through  examples,  several  current  and  potential  uses  of  these  distillations,  to  include,  developing  intuition, 
exploring  concepts,  formulating  meta-models,  and  assisting  in  the  design,  analysis,  and  extrapolation  of  simulation  and  field 
experiments.  We  suggest  these  tools  are  useful  additions  to  any  analyst's  toolbox. 

Generating  Surprise:  Using  Natural  Heuristics  in  the  Search  for  Novelty 

Stephen  C.  Upton 
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Any  non-trivial  combat  simulation  is  characterized  by  very  large  input  spaces,  where  the  input  may  be  in  the  form  of 
simple  parameter  settings  to  more  complicated  data  structures.  Each  “point”  in  this  space  can  be  viewed  as  a  possible 
solution  to  a  problem  confronting  the  agents  in  the  simulation.  We  can  explore  this  space  looking  for  novel  or  surprising 
solutions  using  a  class  of  algorithms  called  natural  heuristics.  Natural  heuristics  are  optimization  techniques  inspired  by 
analogy  to  phenomena  in  the  natural  world.  The  heuristics  include  such  algorithms  as  simulated  annealing,  immune 
algorithms,  and  genetic  algorithms.  As  part  of  the  Marine  Corps'  Project  Albert,  we  are  developing  a  new  set  of  techniques 
based  on  these  natural  heuristics  to  search  for  novelty  in  these  large  simulation  spaces.  We  will  discuss  our  first  experiments 
applying  this  new  methodology  to  agent-based  simulations  in  the  context  of  terrorism  questions  in  tactical  settings. 

Reducing  Non-monotonicities  in  Combat  Models 
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Non-monotonic  behavior  in  combat  models  is  an  important  topic  to  those  using  the  output  of  such  models  as  a  basis  for 
decision-making.  These  decisions  can  be  complicated  by  non-monotonic  behavior  in  the  combat  models.  This  research 
examines  the  Dewar  model,  which  exhibits  non-monotonic  behavior  caused  by  the  chaos  inherent  in  its  structure.  The  dozen 
or  so  previous  papers  on  this  model  have  examined  only  small  subsets  of  this  18  dimensional  combat  model.  The 
combinatorial  possibilities  of  main  effects  and  interactions  among  the  18  dimensions  are  too  great  to  examine  en  masse. 
Consequently,  we  use  some  advanced  statistics  to  explore  the  model  with  three  primary  goals.  First,  systematically  explore 
the  Dewar  model  for  additional  non-monotonic  behavior.  Second,  determine  the  effect  of  stochastic  modeling  on  the  non¬ 
monotonic  behavior  of  the  Dewar  model  response  surface.  Third,  develop  a  method  for  measuring  non-monotonicity  in  the 
response  surface  generated  by  the  model. 
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For  DoD  and  service  decision  makers,  technically  astute  and  fiscally  sound  testing  is  critical  to  accurately  quantify  the 
survivability  and  lethality  of  U.S.  ground  combat  and  munitions  systems  in  analysis  models  and  wargames.  At  the  weapon 
system  level,  deliberate  Army  experimentation  has  been  used  to  fill  critical  data  voids  and  to  develop  new  model  algorithms. 
These  efforts  have  proven  instrumental  to  incrementally  extending  the  applicability  of  the  tri-service  AJEM/  MUVES-S2 
analysis  code  for  ballistic  survivability/vulnerability/lethality  analyses  of  U.S.  Army  and  foreign  weapon  systems.  These 
rigorous  criteria  are  providing  a  critical  foundation  for  analyzing  new  and  emerging  weapon  system  technologies.  Algorithm 
and  code  advances  are  also  supporting  Analyses  of  Alternatives,  U.S.C.  Title  10  Live  Fire  Testing,  and  DoD  5000.2.  In 
February  2001,  the  Army  Test  and  Evaluation  Command  (ATEC)  accredited  MUVES/S2  for  use  in  system  effectiveness 
evaluations  to  support  the  Bradley  M2A3  program  and  for  use  in  shot-line  analyses,  live-fire  pre-shot  predictions,  and 
generating  full-view  system-level  metrics  for  combat  systems  and  munitions.  In  December  2001,  the  U.S.  Army  Research 
Laboratory  presented  another  compelling  MUVES/S2  validation  package  to  ATEC  for  the  BAT  program.  These  efforts  will 
be  leveraged  to  support  other  munitions  in  Army  development  such  as  GMLRS  and  P3I  BAT.  This  paper  succinctly 
describes  the  analytical  approach,  testing  methods,  analysis  techniques,  and  modeling  advances  that  are  being  applied  to 
support  the  evaluation  of  ground  combat  and  munitions  systems  for  current  and  future  frontiers. 
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Development  of  a  Human  Performance  Modeling  Environment  to  Support  Conceptual  Organization 
Evaluation 

B.  Diane  Barnette 
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The  US  Army  Research  Laboratory  (ARL),  established  a  framework  (Barnette  and  Swoboda,  MORS,  2001)  for 
evaluating  a  series  of  experiments  investigating  variations  of  a  concept  organization  consisting  of  a  Fires  and  Effects 
Coordination  Cell  (FECC)  and  a  Field  Artillery  Tactical  Operations  Center  (FA  TOC).  This  organizational  concept  was 
developed  by  the  Depth  and  Simultaneous  Attack  Battlelab  to  move  towards  effects-based  fires  decisions,  centralizing  fires 
resources,  and  affording  opportunities  to  better  accomplish  the  commander’s  intent.  ARL  and  Micro  Analysis  and  Design 
(MAAD),  Boulder  CO,  designed  a  human  performance  model  of  the  FECC  and  a  FA  TOC  to  conduct  ‘what-if  analyses  for 
alternative  organizational  designs,  with  individuals  performing  different  tasks  and  functions,  using  a  prototype  command  and 
control  (C2)  system.  Desiring  greater  flexibility  and  novice  usability  through  the  graphical  users’  interface  (GUI)  of  the 
FECC  model  lead  to  the  design  of  a  modeling  environment  from  which  one  can  develop  multiple  concept  models  for  any 
number  and  size  of  organizations,  staffed  by  any  number  of  people,  performing  any  number  of  tasks  selected  from  a  database 
of  known  and  concept  command  and  control  tasks  and  functions.  This  environment  is  called  C2TRACE  (Command  and 
Control:  Techniques  for  the  Reliable  Assessment  of  Concept  Execution)  and  supports  the  framework  of  multiple  level 
simulation  validation  of  C2  concepts.  This  environment  allows  the  level  of  analysis  to  richly  grow  through  an  iterative 
model-test-model  framework. 
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A  central  feature  of  U.S.  strategy  in  the  War  on  Terrorism  has  been  our  reliance  on  deterring  or  coercing  state  sponsors 
of  terrorism:  by  threatening  force  we  seek  to  coerce  otherwise  unwilling  states  (such  as  Yemen,  Somalia,  or  Sudan)  to  crack 
down  on  terrorists  within  their  borders  without  an  actual  U.S.  attack.  Success  in  such  coercive  campaigns  depends  heavily  on 
the  targets’  risk  acceptance.  The  more  risk  averse  the  leader,  the  more  likely  the  state  is  to  comply  with  our  demands  without 
actual  U.S.  intervention.  The  more  risk  acceptant,  on  the  other  hand,  the  more  likely  the  state  will  be  to  test  U.S.  resolve  by 
withholding  full  compliance.  The  viability  of  U.S.  strategy  -  as  well  as  the  tactics  needed  to  implement  it  -  thus  rest  on  our 
assessment  of  risk  preferences  in  the  target  regimes.  This  paper  thus  presents  a  model  of  risk  preference  as  a  function  of 
leadership  selection  effects  in  unstable  political  systems,  tests  this  model  empirically,  and  argues  from  the  results  that  the 
more  unstable  the  regime,  the  more  likely  its  leadership  will  be  risk  acceptant  “high  rollers’’  requiring  extraordinary  leverage 
to  coerce.  The  paper  then  derives  implications  from  these  findings  for  U.S.  strategy  in  the  war’s  coming  phases. 
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We  present  an  approach  for  representing  human  behavior  and  personality  using  Socrates,  an  agent-based  model  in 
Project  Albert.  Project  Albert  is  a  research  and  development  effort  of  the  Marine  Corps  Combat  Development  Command 
(MCCDC)  to  assess  the  general  applicability  of  the  study  of  complex  adaptive  systems  (CAS)  to  warfare,  and  to  provide  new 
methodologies  for  investigating  the  results  of  running  such  models,  and  incorporating  those  results  with  other,  more 
traditional,  methods  of  analysis. 

We  capture  agent  personality  via  the  ‘Big  5’  Personality  Measures:  (1)  Introversion/Extroversion  (I/E),  (2) 
Agreeableness,  (3)  Conscientiousness  (Task  Orientation),  (4)  Emotional  Stability,  and  (5)  Intel lect/Openness  to  Experience. 
We  examine  agent  behaviors  and  personalities  modeled  in  Socrates  and  address  the  relationships  among  Red,  Blue,  and  other 

agents. 
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As  research  analysts  in  today’s  military,  we  are  often  tasked  with  the  set  up  and  evaluation  of  disparate  and  dispersed 
systems  (sensors,  shooters,  and  decision  makers)  that  are  neither  easily  quantifiable  nor  readily  accessible.  A  primary  means 
of  capturing  user/unit  feedback  and  input  data  is  via  a  survey  instrument.  It  is  recognized  that  design  and  administering 
methodology  impacts  validity,  however  current  OPTEMPO,  personal  turnover,  and  normal  unit  turbulence  also  adds  to  the 
difficulties  facing  analysts  in  their  quest  for  obtaining  usefully  information  in  the  evaluation  of  various  systems.  The  task  of 
collecting  representative  and  accurate  data  is  challenging.  Often  we  are  not  afforded  the  luxury  of  positive  control  when  both 
administrating  and  collecting  surveys.  As  a  result,  the  information  collected  may  or  may  not  be  of  any  use  to  the  researcher. 
This  issue  is  of  concern  due  to  the  amount  of  time  and  energy  spent  both  on  the  researchers  and  units’  behalf.  This  calls  for 
a  careful  review  of  our  present  methodology  to  gather  information,  and  whether  new  approaches  in  the  data  collection 
process  are  needed.  This  paper  addresses  the  problems  that  may  exist  with  our  present  sampling  methodology.  The 
problems  associated  with  sampling  are  addressed  through  the  use  of  a  basic  computer  generated  simulation  based  on  actual 
survey  results.  Several  courses  of  action  are  suggested  to  confirm  whether  the  problem  exists  or  not.  In  the  event  that  there 
is  a  problem,  several  solutions  are  proposed. 
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Jeffrey  R.  Cares 

President,  Alidade  Consulting 
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401-935-9961 
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Most  numerical  analyses  of  Command  and  Control  issues  have  focused  on  the  performance  of  information  technology 
networks,  communication  message  flow  and  individual  cognitive  performance.  New  research  on  human  networks,  social 
dynamics  and  organizational  structure,  however,  is  beginning  to  add  rigor,  formalism  and  numerical  techniques  to  the 
analysis  of  organizational  issues  in  Command  and  Control  structures.  Some  of  the  numerical  techniques  developed  by  this 
research  include  calculation  of  coordination  and  cohesion  statistics,  calculation  of  COA  possibilities  and  calculation  of 
conflict  percentage  in  collective  decision  making  structures.  This  presentation  reviews  how  these  techniques  were  employed 
in  a  recent  analysis  of  naval  command  structures  for  amphibious  operations 
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Counter-deception  and  Sense  Making  During  Urban  Operations 
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The  current  world  situation  begs  us  to  examine  requirements  unique  to  urban  military  operations,  including  counter¬ 
terrorism  and  homeland  defense.  The  United  States  and  its  allies  must  assume  that  adversaries  will  play  to  its  weaknesses, 
which  may  include  capability  to  detect,  make  sense  of,  and  counter  deceptive  operations.  The  focus  of  this  presentation  is  a 
framework  for  information  and  knowledge  to  facilitate  sense  making  and  to  counter  a  sophisticated  capability  for  deception 
during  military  operations  in  urban  operations.  Specific  operational  issues  will  be  discussed  in  the  context  of  the  sense 
making  paradigm  to  better  understand  the  many  complex  factors  (e.g.,  military,  civilian,  political,  social,  and 
physical/environmental)  that  interact  to  influence  military  decisions.  During  urban  operations,  U.S.  Forces  are  susceptible  to 
deception,  particularly  information  deception.  The  quality  of  military  sense  making  and  decision-making  in  urban 
environments  depends,  in  part,  upon  accurate  assessments  of  others’  interests,  intentions,  and  capabilities,  as  well  as  accurate 
assessments  of  the  environment  or  context  within  which  the  action  takes  place.  Forming  accurate  perceptions  is  a  challenge 
even  during  favorable  circumstances  in  which  clear  and  unambiguous  communication  between  parties  or  extensive 
preparation  and  rehearsal  for  a  particular  turn  of  events  can  occur.  In  complex  urban  settings,  we  must  be  prepared  for 
unfavorable  circumstances,  which  might  include  occasions  when  events  are  unfolding  at  a  very  fast  pace  or  when  the 
background  noise  of  contradictory  opinions  interferes  with  the  accurate  gauging  of  the  intentions  of  others.  Included  within 
these  unfavorable  circumstances  is  a  subset  in  which  one  or  more  participants  attempt  to  deceive  the  other.  Clearly,  one  of 
these  requirements  is  the  ability  to  make  sense  of  the  intentions,  capabilities,  and  tactics  of  adversaries.  The  presentation 
suggests  various  “testable”  hypotheses  to  investigate  the  dynamics  of  counter-deception  in  urban  operations. 


Interactive  Hypothesis  Generator  to  Support  Counter-deception  in  Information  Operations  (IO)  via 
Formal  Concept  Analysis  (FCA)  using  Incomplete  Data . 
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A  major  risk  to  the  success  of  military  operations  in  the  21st  century  is  the  failure  to  recognize  and  counter  a  deception. 
In  information  operations  (IO),  we  anticipate  a  highly  sophisticated  and  creative  class  of  equally  active  and  creative. 
Automated  countermeasures  based  on  doctrine  and  history  are  likely  to  be  of  limited  use.  Only  human  domain  experts  will 
be  able  to  apply  informed  intuition  to  "smelling  the  rat"  of  deception  and  uncovering  true  intent.  However,  while  humans 
are  good  generating  relevant  hypotheses,  they  are  less  good  at  discriminating  the  critical  facts  needed  to  test  them.  Formal 
Concept  Analysis  (FCA),  a  tool  for  inducing  lattices  of  concepts  and  relations  from  data,  augments  the  expert  by  providing 
logical  clarity  to  human  understanding  of  relational  data  in  a  visually  compelling  format.  We  propose  a  family  of  interactive 
information  fusion  tools  based  on  FCA  for  IO  counter-deception. 


The  Impact  of  Maintenance  Modeling  for  the  Joint  Biological  Point  Detection  System 

Alan  Dornev  Maj.  Adam  Stroup 

U.S.  Army  Research  Laboratory  U.S.  Army  Research  Laboratory 

Aberdeen  proving  Ground,  MD  Aberdeen  proving  Ground,  MD 

Although  the  Improved  Performance  Research  Integration  Tool  (IMPRINT)  has  been  widely  used  for  its  operational  task 
network  analysis  capability,  it  was  also  designed  to  facilitate  maintenance  requirements  analysis.  IMPRINT  models 
maintainer  manpower  requirements  at  the  system,  unit,  and  force  levels.  The  maintenance  capability  in  IMPRINT  was  used 
to  model  the  Joint  Biological  Point  Detection  System  (JBPDS),  a  system  designed  to  detect  biological  agents  in  a  host  of 
environments.  Due  to  the  recent  threats  against  the  U.S.,  this  system  has  received  increased  attention  and  the  need  for 
expeditious  analysis  of  the  maintenance  requirements  was  critical  to  timely  development  and  deployment.  Through  this 
modeling  effort,  we  determined  that  by  optimizing  maintenance  at  the  organizational  level,  significant  savings  in  time  and 
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manpower  costs  were  realized.  IMPRINT  maintenance  modeling  provided  insight  to  the  overall  JBPDS  maintenance  issues 
and  these  early  insights  will  facilitate  maintenance  predictions  for  product  improvements  to  the  JBPDS  in  the  future. 

Execution  Plan  Selection  and  Validation  for  Ground-Based  Midcourse  Missile  Defense  Command  & 
Control 
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Recent  reviews,  exercises  and  simulations  conducted  with  the  developing  Ground-based  Midcourse  Defense  (GMD) 
Battle  Management,  Command,  Control,  and  Communications  (BMC3)  system  indicate  that  some  significant  usability 
concerns  exist.  Several  reports  identify  the  need  for  more  information  about  how  the  system  is  behaving  or  would  behave 
under  certain  circumstances.  Operators  characterize  this  need  as  a  lack  of  support  for  decision-making  and  task  execution 
tools  within  the  interface  (e.g.,  Holz,  2000;  Allan,  2000),  as  well  as  a  need  for  improved  situation  awareness  as  an  essential 
component  of  Human-in-Control  functionality  (TRW,  2001).  The  current  Build  Increment  2  (BI-2)  interface  provides  users 
with  a  number  of  controls  allowing  them  to  directly  influence  both  how  the  system  fights  the  battle,  and  the  predicted 
outcome  of  the  battle.  However,  operators  are  provided  little,  if  any,  capability  to  appreciate  what  the  outcome  of  such 
actions  will  be  before  the  actions  are  implemented. 

To  address  these  issues,  two  new  Battle  Management,  Command  &  Control  (BMC2)  displays  were  developed  using  an 
Object  Oriented  Task  Analytic  approach  (Steinberg,  2000).  The  new  displays  featured  integrated  decision-making  and 
control  capabilities  intended  to  improve  operator  task  efficiency  and  situation  awareness.  These  two  new  displays  were 
compared  with  the  existing  (BI-2  baseline)  interface  in  two  experiments  to  identify  potential  performance  differences  when 
performing  representative  operator  tasks.  The  first  experiment  assessed  operator  ability  to  perform  complex  data  extraction 
tasks  using  the  three  display  formats,  while  the  second  focused  on  operator  interaction  with  the  displays  while  following  a  set 
of  tactically  relevant  rules.  Results  of  both  experiments  showed  significant  benefits  of  the  new  displays  in  terms  of  response 
time,  with  both  new  displays  outperforming  the  baseline  interface.  In  terms  of  accuracy,  however,  the  baseline  interface  was 
the  best  overall  performer.  Results  also  indicated  which  displays  were  superior  for  supporting  particular  tasks,  and  identified 
display  characteristics  that  improved  operational  performance  in  the  BMC2  environment. 

Development  of  Shared  Situation  Awareness  Methods  for  Collaborative  Command  and  Control 
Environments 
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The  current  method  for  developing  the  Human  Computer  Interface  for  complex  military  systems  fails  to  take  into 
account  multiple  operators  who  will  interact  with  that  system.  Traditionally,  two  approaches  are  taken  in  development  of 
screens  -  first,  to  give  all  operators  access  to  all  screens  thereby  putting  the  burden  on  the  operators  to  define  roles;  second,  to 
physically  segregate  screens  based  on  pre-defined  roles  thereby  removing  any  flexibility  in  adapting  those  roles  for  changing 
environments. 

Emerging  concepts  in  facilitating  group  interaction  or  "team  spaces"  provide  promise  in  maintaining  team  awareness  of 
each  operator  in  three  important  ways  -  first,  to  help  commanders  confirm  that  their  team  is  accessing  appropriate  windows 
and  performing  appropriate  functions;  second,  to  enhance  the  interpersonal  trust  between  operators  that  the  system  is  being 
controlled  properly  and  decreasing  concerns  about  "who  is  doing  what,  when,  and  why";  finally,  to  enhance  man/machine 
trust  by  increasing  situation  awareness  of  the  processes  being  executed  by  not  only  the  operators,  but  the  system  itself. 
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A  Knowledge-Based  System  Evaluation  Methodology  for  the  Armyfs  Battle  Command  System. 
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One  of  the  U.S.  Army  Research  Laboratory's  (ARL's)  Science  and  Technology  Objective  (STO)  research  projects  is  to 
develop  a  methodology  and  metrics  to  quantify  integrated  soldier  and  staff  digital  information  system  performance  on  the 
digital  battlefield.  The  assessment  of  the  human  performance  with  digitalization  is  one  of  the  most  complex  and  challenging 
tasks  that  U.S.  Army  leadership  must  accomplish  to  assure  a  commensurable  return  on  its  digitization  investment.  Military 
organizations  and  their  operations  involve  multitudinous  human  interactions  using  military  personnel  at  various  levels  of 
expertise.  Emerging  digitized  command  and  control  (C2)  systems  have  the  potential  to  help  the  military  accomplish  their 
missions  but  do  not  eliminate  or  lessen  the  human  factor. 

Thus,  a  framework  for  assessing  digital  staff  performance  was  established  that  considers,  hardware,  battle  command 
functions,  soldier  operator  capabilities  as  well  as  staff  and  leader  dynamics.  This  Human  Dimension  of  Battle  Command 
initiative  is  intended  to  help  the  Joint  and  Army  leadership  assess  the  impact  of  digitization  on  individual  soldier,  staff  and 
performance.  The  assessment  will  be  accomplished  by  studying  iterative  Army  Tactical  Command  and  Control  Systems 
(ATCCS),  soldier-system  interface  designs,  and  the  Global  Command  &  Control  System-Army  (GCCS-A)  as  they  support 
command  decision-making  processes,  related  battlefield  operating  systems  (BOS)  C2,  and  information  management 
operations.  The  lack  of  emphasis  on  the  human  component  in  the  design  and  integration  of  automation  can  result  in 
significant  performance  degradation,  increased  training  requirements,  and  a  lack  of  system  acceptance  by  the  soldier. 

Characterizing  the  Terrorist  Threat 
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In  transitioning  from  the  Cold  War  to  the  post-Cold  War  security  context,  several  metaphors  have  been  forwarded  to 
help  characterize  today’s  terrorist  threats.  This  paper  presents  and  develops  three  such  metaphors:  terrorism  as  (1)  a 
corporation,  (2)  a  computer  network,  and  (3)  warfare  by  other  means.  Common  themes  and  lessons  are  drawn  from  these 
metaphors,  most  notably  that  terrorist  networks  are  more  diffuse  than  previous,  Cold  War  era  adversaries  and  that  terrorists 
have  the  potential  to  attack  more  and  different  types  of  targets,  though  less  lethally.  In  conclusion,  it  is  suggested  that 
simulation  can  be  used  to  characterize  terrorist  threats,  the  economic  systems  that  support  them,  and  the  military  and 
economics  systems  that  terrorists  might  target. 

Evaluating  Psychological  Effects  of  Anti-Personnel  Landmines  Using  Unexploded  Ordnance 
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The  long-term  destructive  effects  of  anti-personnel  landmines  (APL)  on  civilians  have  resulted  in  international  support 
for  limiting  the  use  of  APLs.  In  1997  President  Clinton  announced  that  APL  alternatives  be  developed  to  end  use  of  APLs  by 
2003. 

Evaluation  of  APL  alternatives  requires  an  understanding  of  the  psychological  effects  of  landmines.  The  Army 
Research  Laboratory  has  developed  a  methodology  that  evaluates  physiological  and  psychological  stress  and  its  relation  to 
changes  in  task  performance.  A  Comprehensive  Stress  Assessment  Battery  uses  standardized  psychological  trait  and  state 
questionnaires  to  measure  perceptions  of  stress.  A  Salivary  Amylase  Field  Kit  uses  a  saliva  sample  to  provide  a 
physiological  assessment  of  stress.  Amylase  concentrations  are  predictive  of  plasma  catecholamine  levels. 

Kolasinski  (1999)  collected  data  from  individuals  with  APL  experience  in  non-training  settings.  Similarities  were 
reported  between  the  psychological  effects  of  APLs  and  unexploded  ordnance  (UXO).  This  research  proposes  to  assess  the 
psychological  effect  of  UXO  as  a  comparable  measure  of  the  psychological  effect  of  APLs.  Data  were  collected  on  the 
Hawaiian  Island  of  Kaho'olawe  where  long  term  UXO  clearance  operations  are  currently  being  conducted.  The  Kaho'olawe 
UXO  clearance  project  is  a  joint  effort  between  the  Navy  and  the  state  of  Hawaii,  with  the  objective  of  returning  the  island  to 
a  condition  safe  for  human  use. 
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Participants  were  civilian  employees  working  on  the  UXO  clearance  project.  Pre,  during,  and  post  measures  were 
collected  for  four  days.  Baseline  and  trait  measures  were  collected  on  a  non-workday.  Overall  stress  perception  data  and 
physiological  data  indicate  that  UXO  clearance  workers  did  not  experience  high  levels  of  stress.  This  is  likely  due  to 
experience,  training,  and  safety  procedures  in  effect  at  the  work  place.  Highly  trained  explosive  ordnance  disposal  (EOD) 
teams  likely  experience  lower  levels  of  stress  than  the  typical  soldier  exposed  to  APLs.  UXO  clearance  personnel  do  not 
experience  the  time  constraints  and  pressures  of  the  surrounding  battle  that  a  soldier  encounters  when  clearing  a  minefield. 

Exploration  of  IO-specific  CoGs 
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Traditional  Centers  of  Gravity  (CoG)  decompositions,  such  as  Warden’s  theory,  attempt  to  capture  an  adversary’s 
sources  of  power  and  control.  While  they  continue  to  hold  validity  in  today’s  military  operations,  their  value  appears  to  apply 
most  directly  to  the  traditional  kinetic  type  of  war  planning  for  nation  states.  Albeit  attempts  to  transition  existing  approaches 
to  an  Information  Operations  (10)  oriented  arena  have  advanced  adversarial  modeling  research,  some  issues  remain  to  be 
addressed.  I  surmise  that  a  part  of  the  present  problem  is  the  fact  that  previous  CoG  concepts  fail  to  seamlessly  translate  from 
kinetic  to  information  warfare.  As  a  result,  any  attempts  to  simply  apply  a  traditional  CoG  mold  would  only  capture  some  of 
the  dynamics  necessary  for  effective  10  war  planning.  For  instance,  current  CoG  theories  could  be  supplemented  with 
increased  sensitivity  to  ethnocentric  viewpoints.  What  we  may  view  as  the  most  beneficial  or  opportune  route,  may  be  quite 
different  from  that  of  an  adversary  with  a  diverging  frame  of  reference  mediated  by  culturally-based  variables.  Additionally, 
models  fail  to  account  for  an  individual’s  leadership  preferences  by  focusing  on  centers  of  power  and  control  such  as  industry 
and  military.  As  a  supplement  to  existing  CoG  planning/development  theories,  I  am  proposing  a  set  of  CoGs  that  would 
allow  greater  insight  into  other  sources  of  power  that  cover  a  broader  spectrum  of  variables  believed  to  be  important  to 
Information  Operations. 

Determining  the  Homeland  Security  Force  Structure  Requirement 
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Beginning  in  the  spring  of  2000,  the  Army  undertook  efforts  to  change  the  paradigm  of  treating  Homeland  Security  as  a 
lesser-included  force  structure  requirement.  The  results  of  this  shift  led  to  the  development  of  the  Army  Strategic  Planning 
Guidance  (coordinating  draft,  September  10,  2001).  This  planning  guidance  serves  as  the  framework  for  determining  the 
Army’s  force  requirement  to  support  Homeland  Security.  There  are  seven  basic  mission  types  that  are  covered  in  the 
planning  guidance.  The  study  employs  three  techniques  to  determine  the  requisite  force  structure  for  each  mission  type.  The 
first  technique  involved  collecting  known  information  of  current  force  structure  that  had  a  Homeland  Security  role.  The 
second  used  a  forecasting  tool.  Stochastic  Analysis  of  Resources  for  Deployments  and  Excursions  (SARDE)  that  uses 
historical  events  to  predict  the  average  monthly  force  requirement  for  certain  mission  types.  The  final  technique  involved 
basic  set  theory  to  estimate  the  requirement  based  on  several  possible  scenarios.  The  results  of  this  study  were  used  in  the 
Total  Army  Analysis  ’09  process  that  determines  the  desired  total  active  and  reserve  component  requirements  through  year 
2009.  These  results  also  give  a  defensible  force  structure  that  Army  planners  can  use  to  convey  its  requirements  to  the  Joint 
Staff  and  sister  services.  Lastly,  the  study  demonstrates  how  the  Army  is  currently  supporting  the  National  Command 
Authority’s  efforts  to  ensure  the  safety  and  security  of  the  nation. 

Analytical  Techniques  for  the  Development  of  Requirements  Analysis  Using  Situation  Awareness  as 
a  Measure  of  Effectiveness 
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It  often  appears  that  the  primary  design  driver  for  information  technology  (IT)  systems  is  expedience  rather  than  human 
strengths  and  weaknesses.  Many  systems  have  been  designed  to  provide  the  solider  with  the  information  that  can  easily  be 
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obtained  rather  than  by  first  determining  the  type  of  information  that  is  most  needed.  Most  IT  systems  provide  all  the 
information  in  one  modality.  Very  few  systems  provide  processed  information  so  that  higher-level  situation  awareness  can 
be  easily  attained.  In  support  of  the  Smart  Sensor  Web  program,  ARL  developed  an  approach  to  the  design  of  IT  systems 
that  includes:  the  determination  and  documentation  of  critical  information  requirements  (CIRs);  the  determination  of  the 
preferred  modality  of  display  for  each  CIR;  and  the  evaluation  of  sensor  mixes  and  density  needed  to  obtain  the  CIRs.  This 
approach  uses  the  situation  awareness  center  methodology  developed  by  ARL  to  quantify  the  contribution  of  IT  variables  to 
the  SA  of  soldiers  at  the  squad  member,  fire  team  leader,  squad  leader,  and  platoon  leader  echelons 

Comparison  of  Social  Network  Analysis  Techniques 

Capt  Rob  Renfro,  PhD  Dr.  Richard  F.  Deckro,  DBA 

AFSAA/SAFM  AFIT/ENS 

1570  Air  Force  Pentagon,  Washington,  DC  20330  WPAFB,  OH  45433 

703-588-8698  703-588-0220  (fax)  937-255-6565 

robert.renfro@pentagon.af.mil  richard.deckro@afit.edu 

Social  networks  depict  the  complex  relationships  of  individuals  and  groups  in  multiple  overlapping  contexts.  Influence 
in  a  social  network  impacts  behavior  and  decision  making  in  every  setting  in  which  individuals  participate.  This  paper 
defines  a  methodology  for  modeling  and  analyzing  this  complex  behavior  using  a  Flow  Model  representation.  The  results 
using  Flow  Modeling  are  compared  to  existing  Social  Science  methods  both  theoretically  and  for  representative  cases  of 
interest.  Primarily,  the  flow  modeling  approach  is  compared  to  Multi-Dimensional  Scaling  with  respect  to  modeling  and 
analyzing  social  network  phenomenology.  This  paper  is  a  result  of  a  three  year  research  effort  sponsored  by  the  National 
Security  Agency  and  National  Air  Intelligence  Center. 

Human  Science  Data  to  Support  Modeling  and  Analysis  of  Objective  Force 

Lucia  Salvi  Richard  W.  McMahon  Michael  J.  Statkus 

USARL  HRED  USARL  HRED  USA  SBCCOM 

Aberdeen  Proving  Ground,  MD  21005  Aberdeen  Proving  Ground,  MD  21005  Natick,  MA  01760 
410-278-5882  410-278-5997  410-278-5928  410-278-5997  508-233-5076  508-233-4197  (fax) 

The  face  of  the  battlefield  has  changed  dramatically  in  the  past  decade,  and  our  models  and  simulations  must  be 
enhanced  to  reflect  these  changes.  In  order  to  develop  the  modeling  and  simulation  tools  needed  to  assess  new  and  evolving 
technologies  for  the  individual  combatant  of  the  Objective  Force,  it  is  important  to  develop  an  understanding  of  the 
complexities  and  interactions  that  are  involved  during  the  many  different  types  of  future  operations.  Collecting  meaningful 
behavioral  data  from  these  types  of  missions,  to  include  the  military  operations  in  urban  terrain  (MOUT)  environment, 
presents  a  unique  set  of  challenges  to  today’s  researchers.  To  date,  there  is  little  human  performance  data  in  close  combat 
environments  or  MOUT  and  thus  the  Human  Science  Modeling  and  Analysis  Data  Team  was  formed  to  design  and  conduct 
two  studies  to  begin  this  effort.  Both  studies  were  conducted  at  Ft.  Benning,  GA  and  focused  on  target  engagement  and  troop 
movement  performance  data.  The  first  study  was  conducted  in  a  virtual  environment  at  the  Dismounted  Battlespace  Battle 
Lab’s  (DBBL’s)  Simulation  Center  while  the  second  study  was  conducted  in  the  field  at  the  DBBL’s  McKenna  MOUT  Site. 
These  studies  served  several  purposes:  to  assess  the  viability  of  these  facilities  as  data  collection  sites,  to  examine  and 
implement  various  data  collection  methodologies,  to  determine  whether  the  two  data  sets  from  virtual  and  field  environments 
are  correlated,  and  to  use  the  data  in  the  development  and  validation  of  constructive  computer  models  for  the  dismounted 
combatant.  This  paper  describes  the  design  of  these  experiments  and  presents  initial  findings  and  trends. 

Determining  Skills  Required  for  Future  Duties 

Bruce  Sterling.  DB03  Cheryl  Burns,  DB03 

ARL  HRED  ARL  HRED 

Ft  Knox,  KY  40121-5215  Ft  Knox,  KY  40121-5215 

502-624-1964  502-624-4135  (fax)  502-624-1607  502-624-4135  (fax) 

bruce.sterling@knox.armv.mil  chervl.burns@knox.armv.mil 

Future  conflicts  will  require  a  strategically  deployable  and  sustainable  force  that  will  provide  a  quick  reaction  capability 
for  missions  that  will  arise  in  this  century.  The  Future  Combat  System  (FCS)  is  envisioned  to  be  a  mixture  of  manned  and 
unmanned  combat  systems  that  will  exploit  information  dominance  to  develop  a  common,  relevant  operating  picture  and 
achieve  battlespace  situational  understanding.  The  FCS  will  have  to  be  relatively  light  (20  tons)  and  small  in  order  to  be 
deployed  quickly  and  efficiently.  The  FCS’s  success  in  combat  will  depend  on  seeing  and  killing  the  enemy  at  a  distance 
utilizing  robotic  platforms  in  the  air  and  on  the  ground.  Personnel  controlling  these  robotic  platforms  will  utilize  hardware 
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and  software  (operator  control  units-OCUs)  in  order  to  maneuver  the  robotic  platforms;  detect,  classify,  recognize,  identify 
and  engage  the  enemy;  report  battle  damage;  and  maintain  situational  awareness. 

The  Army  needs  to  know  what  skills  are  required  to  perform  OCU  tasks  for  purposes  of  human  factors  design,  training, 
and  selection.  One  skill  taxonomy  that  has  been  useful  in  classifying  human  performance  skills  is  that  of  Fleishman  and 
Quaintance  (1984).  This  taxonomy  organizes  50  individual  skills  into  two  overall  classifications  (cognitive  and  experience 
clusters;  and  perceptual-motor  ability  clusters)  each  containing  four  skill  clusters. 

We  collected  data  during  an  experiment  to  examine  requirements  for  the  FCS  An  objective  of  the  experiment  was  to 
determine  the  skills  and  abilities  required  of  OCU  users.  The  user  task  examined  was  “Maintain  Situational  Awareness 
(SA)”  Results  of  within-subjects  (i.e.,  repeated  measures)  paired  comparisons  of  the  JASS  skill  clusters  for  the  task 
“Maintain  SA”  showed  that  the  highest  rated  skill  clusters  for  “Maintain  SA”  are  “Conceptual”,  “Communication”,  “Speed 
Loaded”,  and  “Vision.”  The  cluster  “Conceptual”  involves  such  skills  as  flexibility  of  closure  (the  ability  to  detect  a  known 
pattern),  visualization  (the  ability  to  predict  how  a  pattern  will  appear  after  changes  are  carried  out),  problem  sensitivity  (the 
ability  to  tell  when  something  is  wrong,  or  likely  to  go  wrong),  and  spatial  orientation  (the  ability  to  tell  where  you  are  in 
relation  to  the  location  of  some  object,  or  vice  versa).  Communication  involves  written  and  oral  expression  and 
comprehension.  The  cluster  “Speed  Loaded”  involves  such  skills  as  speed  of  closure  (combining  different  pieces  of 
information  into  a  meaningful  pattern  quickly),  perceptual  speed  and  accuracy  (comparing  patterns  quickly),  and  time¬ 
sharing  (shifting  back  and  forth  between  sources  of  information,  such  as  different  screens  or  human  versus  computer  input). 
Visual  skills  involve  near  vision,  color  discrimination  and  glare  sensitivity. 

The  presentation  will  discuss  the  highest  ranking  individual  skills  within  each  cluster,  and  human  factors  design, 
training,  and  selection  necessary  to  ensure  that  FCS  OCU  operators  are  able  perform  these  skills. 
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Measures  of  10  Effects 

Pat  Allen 
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Suffolk,  VA  23435 
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pat.allen@gd-ais.com 

The  Joint  Staff  Analysis  Model  (JSAM)  was  developed  for  the  US  Army  Battle  Command  Battle  Lab  to  analyze 
command  post  performance.  JSAM  has  been  selected  as  the  Army’s  J/AWE  tool  to  support  Millennium  Challenge  02.  One 
application  of  JSAM  is  to  develop  some  measures  of  the  effects  of  selected  information  operations  on  Blue  or  Red 
organizations.  Since  JSAM  already  models  the  performance  of  an  organization  without  IO,  including  IO  effects  will  provide 
quantitative  measures  of  IO  on  organizational  performance.  Measures  include  times  to  complete  tasks,  resource  utilization 
over  time,  quality  of  information  products,  effects  on  coordination,  and  other  measures  already  represented  in  JSAM.  Note 
that  these  are  not  all  of  the  measures  possible  for  IO,  nor  do  they  represent  measures  of  all  types  of  IO.  However,  this  set  of 
measures  is  a  useful  starting  point  for  developing  more  objective  measures  of  a  wide  range  of  offensive  and  defensive  IO. 
We  present  a  proposed  approach  for  incorporating  a  JSAM-based  IO  analysis  as  part  of  a  limited  objective  experiment  for 
Millennium  Challenge  02. 

Sustaining  Continuous  Joint  Concept  Development  and  Experimentation  Strategy 

Ms  Myra  Baugh  LTC  John  Dannon 

Joint  Futures  Lab/J9,  Joint  Forces  Command  Joint  Futures  Lab/J9,  Joint  Forces  Command 

1562  Mitscher  Avenue,  Suite  200  1562  Mitscher  Avenue,  Suite  200 

Norfolk,  VA  2355 1  Norfolk,  VA  2355 1 

757-836-3968  (fax  757-836-2835),  baughm@ie.ifcom.mil  757-836-2305  (fax  757-836-2835),  dannoni@ie.ifcom.mil 

Joint  Forces  Command,  Joint  Futures  Lab  is  a  relatively  young  organization.  One  of  the  challenges  faced  by  the 
organization  is  establishing  a  battle  rhythm  that  synchronizes  DoD's  Transformation  effort  with  the  Service  Components  and 
CINCs. 

This  presentation  will  submit  the  latest  battle  rhythm,  as  well  as  modified  naming  conventions,  developed  for  sustaining 
continuous  Joint  Concept  Development  and  Experimentation.  A  single  pathway  of  concept  development  and 
experimentation  will  be  described  as  well  as  the  synchronization  of  concept  development  and  experimentation  pathways  that 
repeats  a  24  month  cycle.  This  process  provides  the  necessary  analytical  rigor  as  well  as  agility  and  flexibility  to  JCD&E. 

Multinational  Collaboration  and  Information  Sharing  Limited  Objective  Experiments 

Keith  P.  Curtis 

The  MITRE  Corporation 
McLean,  VA  22102-7508 
757-836-3724  (fax  757-836-8240) 
kcurtis@mitre.org 

This  paper  describes  a  series  of  Multinational  Collaboration  and  Information  Sharing  Limited  Objective  Experiments 
(LOEs)  that  examine  multinational  aspects  of  joint  command  and  control  concepts  at  the  US  Joint  Forces  Command 
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(USJFCOM).  The  experimental  goal  is  to  better  understand  how  multinational  partners  should  share  information  and  do 
collaborative  planning  and  execution  in  the  future.  The  Multinational  LOEs  also  aid  in  defining  multinational  participation  in 
Olympic  Challenge  2004  (OC04),  a  major  USJFCOM  experiment  that  will  examine  Rapid  Decisive  Operations  (RDO)  in  the 
2010-2020  timeframe.  USJFCOM  Joint  Futures  Lab  conceived  RDO  as  a  way  to  deal  with  future  adversaries  in  an 
expeditious  manner.  Since  it  is  unlikely  that  the  U.S.  forces  would  act  unilaterally  against  an  adversary,  it  is  important  that 
the  RDO  concept  include  provisions  for  coalition  partners. 

LOEs  are  designed  to  be  both  discovery  events  and  structured  experiments.  Since  LOEs  are  pilot  efforts  for  larger  more 
complex  events  that  follow,  there  is  an  element  of  discovery  that  is  extremely  useful.  It  is  far  better  to  discover  flaws  in  a 
small  venue  when  corrections  are  easier  rather  than  a  large  public  event  where  correction  is  difficult.  The  Multinational  LOEs 
are  also  structured  to  examine  assertions  made  by  joint  concepts.  Measures  and  associated  data  collection  quantify  the  degree 
to  which  collaboration  and  information  sharing  take  place  under  different  conditions. 

The  first  Multinational  LOE  was  completed  in  November  2001  and  focused  on  collaborative  planning  with  Multinational 
partners  who  are  planning  RDO  when  the  planning  time  is  short.  The  experiment  compared  COAs  developed  using  a 
traditional  process  with  a  plan  using  an  integrated  planning  process.  The  traditional  planning  process  was  adapted  from  the 
Multinational  Interoperability  Council  (MIC)  Lead  Nation  Concept,  and  the  integrated  planning  process  was  based  on  the 
Joint  Command  &  Control  Capability  (JCCC)  and  the  Standing  Joint  Command  &  Control  Element  (SJC2E).  Both  support 
development  of  an  RDO  ONA. 

The  Multinational  LOE  was  also  an  opportunity  to  collect  valuable  information  on  distributed  collaborative  planning. 
Data  were  collected  through  observers,  surveys,  and  questionnaires,  which  were  used  to  characterize  the  two  methods  used  to 
develop  COAs.  Data  collection  was  a  mutual  effort  of  research  centers,  laboratories,  and  organizations  from  the  participating 
nations. 


Millennium  Challenge  2002  Model-Experiment-Model  Methodology 


MAJ  Sean  T.  Deller 

U.S.  Joint  Forces  Command 
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Norfolk,  VA  23551-2488 
757-836-2291  (fax  757-836-2885) 
dellers  @  ie.  ifcom.mil 

United  States  Joint  Forces  Command  will  use  a  Model-Experiment-Model  (M-E-M)  paradigm  to  overcome  some  of  the 
limitations  of  conducting  a  large,  single-trial  field  experiment  and  to  establish  the  foundation  of  a  continuous  experimentation 
environment.  Since  MC02  does  not  have  an  “on-the-ground”  baseline  to  determine  effectiveness  gains,  the  focus  in  M-E-M 
is  to  build  a  constructive  baseline  for  comparison  to  a  constructive  Rapid  Decisive  Operations  Joint  Task  Force  variation  that 
has  been  calibrated  to  the  results  of  the  field  experiment.  The  use  of  M-E-M  in  Millennium  Challenge  2002  (MC02)  will  be 
as  a  “proof-of-principle”  intended  to  determine  its  potential  and  the  process  with  which  to  integrate  it  into  joint 
experimentation. 


Rapid  Initialization  of  Course  of  Action  (COA)  Tools  Using  Data  from  GCCS 
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Over  the  past  several  years,  simulations  have  been  increasingly  used  as  a  way  of  developing  and  evaluating  courses  of 
action  (COAs)  during  staff-level  training  exercises.  However,  one  of  the  major  drawbacks  in  using  such  tools  in  the  inability 
to  rapidly  populate  such  simulations  with  data  that  exists  in  C4ISR  systems.  In  the  majority  of  instances,  unit  data  is  read 
directly  off  of  the  available  C4ISR  system  and  input  manually  into  the  COA  simulation.  This  process  can  be  time  consuming 
and  is  prone  to  errors  -  due  to  both  the  manual  nature  of  the  process  and  the  fact  that  the  tactical  picture  may  change 
significantly  by  the  time  all  the  data  has  been  input. 

During  the  Navy's  Global  '01  Wargame  last  year,  an  automated  process  for  initializing  the  Naval  Simulation  System 
(NSS)  based  directly  on  available  track  data  in  the  Global  Command  and  Control  System  (GCCS)  was  used  for  the  first  time 
in  an  exercise.  The  interface  leverages  standard  M&S  and  C4I  architectures  -  employing  components  based  on  the  DII  COE 
and  the  High  Level  Architecture  (HLA).  Use  of  this  capability  led  to  a  significant  improvement  in  the  speed  in  which  NSS 
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could  be  initialized,  and  also  the  accuracy  of  the  COAs  evaluated.  Because  it  was  used  directly  by  the  NAVFOR  cell  in  the 
exercise,  it  helped  to  streamline  the  C2  decision  process  for  the  training  audience.  The  success  of  this  application  has  led  the 
Navy  to  employ  it  on  the  USS  Coronado  during  the  upcoming  Fleet  Battle  Experiment  -  Juliet  (FBE-J),  during  the  summer  of 
2002. 

This  year  the  GCCS-NSS  interface  was  extended  to  include  a  second  COA  application  -  the  Integrated  Theater 
Engagement  Model  (ITEM).  The  GCCS-ITEM  initialization  capability  will  be  used  during  exercise  Reception,  Staging,  and 
Onward  Integration  (RSOI)  in  Korea  in  the  Spring  of  2002,  and  again  during  exercise  Ulchi  Focus  Lens  (UFL)  in  Korea  later 
in  2002. 

This  presentation  will  cover  lessons  learned  in  all  of  the  exercise  and  experimental  uses  outlined  above  and  discuss 
future  plans  for  both  applications.  It  will  also  discuss  potential  future  areas  involving  the  interoperability  of  C4ISR  and  M&S 
systems  that  could  significantly  improve  the  C2  decision  process. 

Wargaming  to  Support  Objective  Force  Concept  Development 

Ms.  Rochelle  A.  Hill 

TRADOC  Analysis  Center,  ATRC  -  FF 
255  Sedgwick  Ave 
Ft.  Leavenworth,  KS  66027 
913-684-9320  (fax  913-684-9189) 
hillr@trac.army.mil 

The  Objective  Force  is  the  realization  of  the  Army  vision  that  was  presented  by  the  Chief  of  Staff  of  the  Army  (CSA)  in 
October  1999.  The  transformation  from  vision  to  fielded  Objective  Force  is  a  process  that  will  occur  over  several  decades. 
An  early  and  critically  important  piece  of  this  process  is  the  development  of  Operational  and  Organizational  (O&O) 
Concepts.  These  Objective  Force  O&O  concepts  are  grounded  in  the  futures  work  that  was  done  as  part  of  the  Army  After 
Next  (AAN)  project.  Futures  wargaming  has  evolved  to  become  an  important  part  in  the  development  of  these  concepts.  In 
particular,  the  annual  Army  Transformation  Wargame  (ATWG)  has  emerged  as  the  Army’s  most  visible  event  for  future 
concept  development. 

The  TRADOC  Analysis  Center  (TRAC)  serves  as  the  lead  analytic  agency  for  the  ATWG  sponsored  by  the  TRADOC 
Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  This  series  of  wargames  is  designed  to  describe,  refine  and  evaluate 
Objective  Force  concepts  and  capabilities  over  a  multi-year  period.  These  wargames  provide  the  Army  an  opportunity  to 
explore  future  Army  operations  at  the  strategic  and  operational  levels  of  war  in  a  political/military  wargame  environment. 

This  presentation  will  address  the  analytic  support  provided  to  ATWG  01,  Vigilant  Warriors.  In  particular,  it  will 
provide  an  overview  of  the  wargame  to  include  analysis  and  reporting  of  the  insights  for  the  issues  addressed. 
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Effects-based  Operations  (EBO)  is  defined  as  a  “process  for  obtaining  a  desired  strategic  outcome,  or  ‘effect’  on  the 
enemy,  through  the  synergistic  and  cumulative  application  of  the  full  range  of  military  and  nonmilitary  capabilities  at  all 
levels  of  conflict.”  (p  1}  An  effect  is  the  physical,  functional,  or  psychological  outcome,  event,  or  consequence  that 
results  from  specific  military  or  non-military  actions.  The  EBO  concept  is  based  on  the  tenant  that  a  better 
understanding  of  the  adversary  and  the  increased  involvement  of  other  national  agencies  will  lead  to  better-reasoned 
options  to  engage  potential  adversaries. 

Key  aspects  of  EBO  are  the  ability  of  decisionmakers  to  quickly  recognize  any  unexpected  effects  and  the  flexibility 
and  agility  to  adapt  to  the  implications  of  those  effects.  This  highly  adaptive  quality  is  anticipated  to  increase  prospects 
for  success  while  reducing  the  potential  for  failure.  A  second  key  aspect  of  EBO  is  an  emphasis  on  the  ability  to 
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examine  the  causal  linkages  and  effects  through  which  actions  lead  to  objectives.  Causal  linkages  help  planners 
understand  why  a  proposed  action  could  be  expected  to  produce  a  desired  effect  given  the  current  circumstances.  A  third 
aspect  is  the  broadened  focus  of  the  Joint  Task  Force  (JTF)  Commander  to  producing  effects  against  an  adversary’s  will 
and  behavior  in  addition  to  his  means  and  capabilities.  This  ability  to  more  precisely  select  the  right  set  of  actions  offers 
the  Joint  Force  Commander  the  ability  to  further  minimize  undesired  collateral  effects. 

An  experiment  entitled  Effects  Tasking  Order-to- Actions  Limited  Objective  Experiment  (ETO-to- Actions  LOE), 
was  conducted  at  the  US  Joint  Forces  Command  (JFCOM),  Joint  Experimentation  Center,  Suffolk,  VA,  3-14  December, 
2001,  to  examine  aspects  of  EBO,  and  to  specifically  assess  and  refine  the  effects-based  planning  and  assessment 
(EBPA)  processes.  This  experiment  was  designed  and  conducted  by  a  partnership  of  the  Naval  Postgraduate  School, 
JFCOM  J9,  and  the  Navy  Warfare  Development  Command.  Previous  experiments  and  events  focused  primarily  on  the 
Joint  Force  Headquarters  (JFHQ)  level  of  command,  with  the  majority  of  effort  directed  at  refining  the  process  down  to 
producing  an  ETO  (which  effectively  issues  effects-based  orders  to  the  subordinate  functional  components).  The  ETO- 
to-Actions  LOE  focused  within  and  below  the  JFHQ  to  examine  the  required  coordination  and  collaboration  processes 
(both  vertically  and  horizontally)  between  the  JF  and  functional  components  headquarters,  which  is  needed  to 
collaboratively  develop  the  ETO  and  translate  the  effects  directed  in  it  into  tactical  actions  on  the  battlefield. 

The  experimental  participants  included  representatives  from  all  services,  organized  into  a  Joint  Task  Force  HQ  staff 
and  functional  component  HQ  staffs  (air,  maritime,  land,  special  operations  force,  and  political).  Thirty-nine  percent 
were  active  duty  and  forty-two  percent  were  retired  military  personnel.  Three  days  of  training  on  the  new  processes  and 
collaboration  tools  were  provided  to  familiarize  participants  with  the  new  concepts.  Five  days  of  game  execution 
consisted  of  the  collaborative  planning  between  the  Joint  Task  Force  staff  and  the  subordinate  functional  component 
staffs,  culminating  in  the  JTFC  issuing  an  ETO  to  the  Joint  Force. 

Three  surveys  were  administered  during  the  experiment  to  gather  data  on  the  effectiveness  of  (1)  the  collaborative 
tools  and  the  training  provided  to  the  participants  for  this  experiment,  (2)  knowledge  management  and  collaboration  as 
critical  aspects  of  EBO  planning,  and  (3)  the  EBO  planning  and  assessment  process.  This  paper  reports  on  the  results  of 
the  Knowledge  Management  and  Collaboration  Survey,  and  is  a  companion  paper  to  two  other  papers  that  report  on 
results  of  the  other  two  surveys.  Twenty-nine  items  comprised  the  KM  survey.  Participants  were  asked  to  rate  the  extent 
to  which  they  agreed  with  statements  by  using  a  five-point  Lickert  scale  that  ranged  from  “strongly  disagree”  to 
“strongly  agree.”  The  survey  was  administered  to  the  99  experimental  participants;  95  completed  surveys  were  returned. 

Survey  items  related  to  situation  assessment  and  information  management  asked  participants  about  their  level  of 
situation  awareness  within  their  cell  and  across  the  JTF/Component  organization,  their  ability  to  obtain  adequate  and 
timely  information,  types  of  information  they  were  unable  to  obtain  and  causes  of  problems  in  obtaining  information. 
Other  survey  items  pertained  to  the  effectiveness  of  the  organization  the  effectiveness  of  asynchronous  collaboration 
sessions;  and  the  extent  io  which  they  were  able  to  conduct  collaborative  planning  that  was  closely  coordinated  with 
subordinate  commands.  In  addition,  survey  items  measured  the  effectiveness  of  the  ONA,  ability  to  assess  the  value  of 
engaging  a  specific  adversary  node,  and  the  presentation  aspects  of  information. 

1  A  Concept  Framework  for  Effects-Based  Operations ,  White  Paper  Version  1.0,  18  October  2001.  US  Joint 
Force  Command,  J9,  Concepts  Department,  Suffolk,  VA. 

2  Operational  Net  Assessment,  TTP  for  MC02,  Draft  Version  1.2,  20  November  2001.  US  Joint  Force  Command, 
J9,  Concepts  Department,  Suffolk,  VA. 
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An  overarching  theme  driving  the  development  of  future  joint  military  organizations  is  the  need  for  Rapid  Decisive 
Operations  (RDO).  Rapid  decisive  operations  are  characterized  by  immediate,  high-tempo,  continuous  overwhelming 
operations,  and  the  ability  to  shape  and  control  the  battlespace,  integrate  application  of  precision  effects  and  dominant 
maneuver,  and  minimize  the  need  for  protracted  campaigns.  To  facilitate  RDO,  a  number  of  emergent  concepts  are  being 
investigated  at  US  Joint  Forces  Command  (USJFCOM),  Suffolk,  VA,  including:  the  Experimental  Joint  Force  Headquarters, 
Joint  Interactive  Planning,  and  a  Common  Relevant  Operational  Picture.  These  concepts  reflect  the  need  for  unprecedented 
human  and  technological  synergy  in  organizational  structure,  process,  collaboration  and  display  media,  and  adaptation  to 
dynamic  circumstances.  Of  particular  importance  is  the  nature  and  method  of  information  exchange  that  RDO  will  require  in 
a  network-centric  environment. 

The  objective  of  Global  2001  was  to  explore  NCO  by  conducting  Joint/Coalition  contingency  operations  with  uncertain 
warning  using  rapidly  deployable  forces.  Two  specific  concepts  were  used  as  implementing  vehicles:  Rapid  Decisive 
Operations  (RDO)  and  the  Joint  Mission  Force.  These  vehicles  were  intended  to  support  investigation  of  several  focus  areas, 
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one  of  which  is  the  focus  for  this  paper:  Decisionmaking  in  an  Information  Rich  Command  and  Control  Environment.  This 
paper  will  present  results  of  analysis  of  data  collected  to  help  refine  emerging  concepts  being  defined  at  USJFCOM  related  to 
C2  in  an  information-rich  environment. 

A  survey  was  administered  to  obtain  data  on  organizational  effectiveness,  information  flow  and  knowledge  management, 
collaboration,  situation  awareness,  and  the  use  of  advanced  information  technology  tools.  In  addition,  a  team  of  observers, 
stationed  throughout  the  organization  recorded  key  observations  related  to  operational  performance  and  the  emerging 
concepts  being  investigated  at  USJFCOM.  The  objective  was  to  glean  insights  that  can  help  expand  and  refine  the  emerging 
concepts  being  developed  to  transition  to  Joint  Vision  2020.  Results  of  analysis  of  data  gathered  from  59  participants  who 
completed  the  survey  will  be  discussed. 

An  Integrated  Gaming  System  for  the  Army  Transformation  Wargame 
Mr.  Eric  Johnson 

TRADOC  Analysis  Center,  ATRC  -  FF 
255  Sedgwick  Ave 
Ft.  Leavenworth,  KS  66027 
(913)  684 -9287,  FAX  9189 
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The  Integrated  Gaming  System  (IGS)  is  an  integrated,  model-supported  gaming  system  consisting  of  a  set  of  tools  linked 
to  a  common  database  and  capable  of  supporting  a  wide  range  of  gaming  requirements.  The  U.S.  Army  Training  and 
Doctrine  Command  (TRADOC)  Analysis  Center  (TRAC)  provides  contract  oversight  management  for  the  development  and 
use  of  the  IGS  in  support  of  the  TRADOC  Deputy  Chief  of  Staff  for  Doctrine  (DCSDOC).  The  Wargaming  and  Futures 
Directorates  within  DCSDOC  are  the  program  and  systems’  sponsors. 

The  IGS  is  a  Booz- Allen  &  Hamilton  (BAH)-developed  wargame  automation  system  that  fulfills  the  functional 
requirements  of  the  Wargame  Architecture  (WGA)  concept,  which  developed  out  of  requirements  identified  by  DCSDOC 
beginning  in  1996.  DCSDOC  identified  these  requirements  while  preparing  for  a  series  of  wargaming  events  that  supported 
the  Army  After  Next  (AAN)  future  studies  effort.  The  purpose  of  the  IGS  is  to  perform  the  functions  of  the  WGA  in  support 
of  TRADOC’s  Army  Transformation  wargame,  study,  and  research  efforts.  This  presentation  provides  an  overview  of  the 
IGS  system,  its  components,  and  its  use  during  last  year's  Army  Transformation  Wargame  -  Vigilant  Warriors  01. 
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The  United  States  Joint  Forces  Command  (USJFCOM)  J9  is  leading  a  transition  toward  a  new  approach  to 
warfare.  A  cornerstone  of  this  new  approach  is  the  concept  of  Rapid  Decisive  Operations  (RDO),  which  integrate 
knowledge,  command  and  control,  and  Effects-based  Operations  (EBO)  to  achieve  the  desired  strategic  outcome  or 
“effect”  on  the  enemy  through  the  synergistic  and  cumulative  application  of  the  full  range  of  military  and 
nonmilitary  capabilities  at  all  levels  of  conflict.1  In  preparing  for  and  conducting  a  RDO,  the  military  acts  in 
concert  with  and  leverages  the  other  instruments  of  national  power  to  understand  and  reduce  the  adversary’s  critical 
capabilities  and  coherence.  Focusing  on  effects,  rather  than  attrition,  enables  a  highly  coordinated  level  of 
interservice,  interagency,  and  international  cooperation. 

The  shift  to  EBO  effects  both  planning  and  assessment.  Traditionally,  military  planners  would  focus  on 
consideration  of  factors  such  as  the  number  and  type  of  aircraft  to  be  employed,  types  and  quantity  of  weapons  to  be 
used,  and  the  number  of  sorties  to  be  flown.  Now  the  goal  is  to  emphasize  what  all  these  weapons  and  platforms  will 
accomplish,  that  is,  what  overall  outcomes  will  be  achieved.3  Similarly,  the  effects  assessment  (EA)  process  goes 
beyond  traditional  attrition-related  and  performance-related  assessments  included  in  today’s  combat  assessment 
process.  EA  must  be  a  continuous  feedback  process  that  can  collect,  process,  exploit,  and  disseminate  information  to 
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the  appropriate  level  (strategic,  operational,  or  tactical)  in  time  spans  that  allow  commanders  to  make  decisions  in  an 
intensely  dynamic  situation.  The  EA  perspective  includes  “determination  of  whether  some,  or  all  of,  the  desired 
effects  were  produced  and,  if  so,  to  what  level,  what  unintended  effects  were  produced,  their  overall  impact  on  the 
joint  effort,  and  how  the  tactical  actions  taken  either  contributed  or  failed  to  contribute  to  obtaining  the  desired 
outcome.” 3  The  experiment  reported  on  in  this  paper  is  part  of  a  sequence  of  experiments  and  events  planned  to  test 
and  refine  new  concepts  being  developed  at  USJFCOM  J9. 

An  experiment  entitled  Effects  Tasking  Order-to- Actions  Limited  Objective  Experiment  (ETO-to- Actions 
LOE),  was  conducted  at  the  USJFCOM,  Joint  Experimentation  Center,  Suffolk,  VA,  3-14  December,  2001,  to 
examine  aspects  of  EBO,  and  to  specifically  assess  and  refine  the  effects-based  planning  and  assessment  (EBPA) 
processes.  This  experiment  was  designed  and  conducted  by  a  partnership  of  the  Naval  Postgraduate  School,  JFCOM 
J9,  and  the  Navy  Warfare  Development  Command.  The  previous  experiments  and  events  focused  primarily  on  the 
Joint  Force  Headquarters  (JFHQ)  level  of  command,  with  the  majority  of  effort  directed  at  refining  the  process 
down  to  producing  an  ETO  (which  effectively  issues  effects-based  orders  to  the  subordinate  functional  components). 

The  ETO-to-Actions  LOE  focused  within  and  below  the  JFHQ  to  examine  the  required  coordination  and 
collaboration  processes  (both  vertically  and  horizontally)  between  the  JF  and  functional  components  HQs,  which  is 
needed  to  collaboratively  develop  the  ETO  and  translate  the  effects  directed  in  it  into  tactical  actions  on  the 
battlefield. 

This  paper  will  focus  on  summarizing  data  obtained  from  a  survey  administered  at  the  conclusion  of  this 
experiment  to  obtain  feedback  on  how  well  the  EBPA  process  worked.  Survey  items  asked  respondents  to  rate  their 
answers,  using  a  5-point  Lickert-type  scale  that  ranged  from  "strongly  disagree"  to  "strongly  agree,"  on  questions 
that  asked  about  such  topics  as  the  following:  areas  of  the  effects-based  planning  and  assessment  process  needing 
further  refinement,  what  parts  of  the  process  are  particularly  challenging  (so  that  these  can  be  enhanced  and  more 
fully  trained),  what  data /  information/assessments  need  to  be  provided  to  better  enable  the  process,  how  well  this 
process  facilitates  development  of  more  complete/  robust  courses  of  action,  and  whether  JTF  planners  were  able  to 
develop  measures  of  effectiveness  for  the  desired  effects  that  were  meaningful  and  observable.  Additional  areas 
included  in  the  survey  include  items  regarding  whether  use  of  the  Prioritized  Effects  List  supports  JTF-level 
decision  making,  whether  the  right  number  of  people  were  involved  in  the  planning  process,  the  ease  with  which 
participants  were  able  to  stay  informed  when  updates  and  changes  were  made,  the  effectiveness  of  the  components 
participation  in  the  planning  process,  and  several  other  aspects  of  the  effects-based  planning  and  assessment  process. 


1.  U.S.  Joint  Forces  Command:  A  Concept  for  Rapid  Decisive  Operations  White  Paper  Version  2.0  Final 
Draft.  25  October  2001. 

2.  Mann,  Edward  C.  Ill  Col  (Ret),  Endersby,  Gary,  Lt  Col  (Ret),  and  Searle,  Tom,  (2001).  Dominant  Effects: 
Effects  Based  Thinking  for  Joint  Operations,  Airpower  Research  Institute,  College  of  Aerospace  Doctrine, 
Research,  and  Education,  Air  University. 

3.  U.S.  Joint  Forces  Command,  Joint  Experimentation  Directorate,  Concepts  Department:  Effects-based 
Operations  White  Paper  Version  1.0.  18  October  200 1 . 
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Rapid  access  to  current,  relevant,  and  accurate  information  and  the  ability  to  engage  in  real-time  collaboration  with 
other  decisionmakers  who  are  geographically  distributed  have  become  indispensable  elements  of  the  Joint  command  and 
control  (C2)  planning  and  decisionmaking  process.  Collaboration  tool  suites  were  introduced  to  facilitate  these 
information-intensive  interactions  during  two  recent  events.  These  events  were  Global  Wargame  2001,  held  at  the  Naval 
War  College,  in  Newport,  RI,  16-27  July  2001,  and  an  experiment  conducted  at  US  Joint  Forces  Command,  Suffolk,  VA, 
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3-14  December  2001.  New  information  technology  (IT)  tools,  used  as  part  of  a  networked,  web-based  collaborative 
system  were  also  introduced.  These  tools  were  developed  to  support  operational  planning  and  decisionmaking  processes 
by  providing  an  alternative  means  to  communicate,  collaborate,  and  share  information  among  warfighters  that  extends 
what  is  available  in  today’s  current  operational  environments.  A  key  objective  for  both  events  was  to  obtain  empirical  data 
on  the  effectiveness  of  these  new  tools  for  supporting  future  operations  in  a  distributed,  network-centric  joint  force  and  to 
identify  user  defined  enhancements  that  would  better  meet  future  Joint  operations  requirements. 

The  need  for  extensive  collaboration  and  coordination  across  functional  areas  and  components  within  the 
organization  to  accomplish  the  mission  was  recognized  as  key  to  the  success  of  both  events.  Enabled  by  high-speed 
bandwidth  connectivity  and  electronic  collaboration  tools,  a  collaborative  information  environment  is  anticipated  to 
facilitate  the  exchange  of  information  among  members  of  the  Joint  Force  and  those  organizations  supporting  or  being 
supported  by  the  Joint  Force.  The  Joint  Task  Force  conducted  effects-based  planning  and  assessment  in  a  collaborative 
information  environment  that  provided  decisionmakers  the  ability  to  share  information  and  produce  the  recurring  and  non¬ 
recurring  products  that  were  required.  The  long-term  goal  for  operating  in  a  collaborative  environment  is  to  reduce 
planning  timelines  while  increasing  organizational  effectiveness. 

A  web-based  tool,  called  the  Wargaming  Information  Grid  System  (WIGS),  and  a  collaborative  planning  and 
operational  environment,  the  Information  Workspace  (IWS),  provided  the  core  for  both  collaboration  tool  suites.  At 
Global  Wargame,  where  the  goal  was  to  use  innovative  technologies  to  enhance  all  aspects  of  the  operational 
decisionmaking  process,  the  following  tools  were  provided  to  participants  in  addition  to  WIGS  and  IWS:  Battlespace  NT, 
Text  Documents,  the  Knowledge  Wall,  Email,  Text  Chat,  Voice,  and  Video  Teleconferencing.  At  US  Joint  Forces 
Command,  where  one  goal  for  the  experiment  was  to  develop  an  understanding  of  the  implications  and  effects  of 
distributed  planning,  the  following  tools  were  provided  to  participants  in  addition  to  WIGS  and  IWS:  ADOCS,  ONA 
Tool,  and  JDIM.  The  automated  deep  operations  coordination  system  (ADOCS)  is  a  joint  service  mission  management 
software  application  that  presented  the  visual  display  of  the  battlespace.  ADOCS  provides  a  suite  of  tools  and  interfaces 
for  horizontal  and  vertical  integration  across  battlespace  functional  areas.  The  operational  net  assessment  (ONA)  tool  was 
accessed  through  WIGS  and  provided  an  initial  assessment  of  the  military  operation  from  multiple  points  of  view.  These 
other  views  include  information  and  analysis  from  other  branches  of  the  US  Government  and  many  others  as  well  as  non¬ 
governmental  organizations'  needs  and  requirements.  The  Joint  Distributed  ISR  Management  Tool  (JDIM)  enabled  the 
user  to  find  what  intelligence,  surveillance,  and  reconnaissance  information  existed  at  particular  nodes. 

The  Information  Workspace  (IWS)  is  a  collaborative  planning  and  operational  environment  designed  to  be  used 
within  and  among  the  functional  and  service  components.  IWS  was  designed  to  facilitate  collaboration  where  planning 
was  required  to  produce  the  recurring  and  non-recurring  products  produced  in  response  to  the  game  play.  Capabilities 
afforded  by  IWS  were  expected  to  be  tailored  by  the  users  to  their  specific  requirements.  Some  functions  provided  by 
IWS  include  real-time  text  chat  and  voice,  both  conducted  over  the  internet.  Text  chat  is  a  tool  within  IWS,  and  provides  a 
form  of  interactive  communication  where  more  than  one  person  can  join  the  chat  session  to  collaborate.  All  occupants 
within  a  virtual  “room”  (within  the  IWS  tool)  can  view  and  respond  interactively  to  an  initiator’s  message.  Voice  is  also  a 
tool  within  the  IWS  where  a  person  can  talk  with  everyone  who  is  in  the  same  “room.” 

The  War-Gaming  Information  Grid  System  (WIGS)  was  designed  to  be  the  central  source  for  shared  awareness 
during  scenario  play.  WIGS  was  developed  to  be  the  authoritative  data  source  for  game  information.  For  Global 
Wargame  2001,  an  interactive  homepage  was  developed  to  provide  players  with  a  means  of  planning,  communicating,  and 
promulgating  orders.  Promulgation  of  this  information  via  the  website  was  intended  to  facilitate  changes  to  the  common 
operational  picture  and  also  provide  for  review  of  players’  decisions,  strategy,  and  direction  both  during  game  play  and 
afterwards. 

The  objectives  for  this  website  were  to:  (1)  provide  a  location  to  post  information  for  all  players,  (2)  provide  access  to 
analytic  tools  and  to  an  underlying  database  of  reference  and  briefing  materials,  (3)  facilitate  posting  and  exchange  of 
documents,  as  well  as  (4)  provide  links  to  additional  websites,  hosted  within  the  Wargaming  Center,  NWC,  in  order  to 
provide  additional  information  related  to  game  play.  Text  documents  were  a  collection  of  documents  located  within  the  web- 
based  gaming  architecture.  These  documents  included  material  such  as  the  Battle  Plan,  Commander’s  Intent,  Rules  of 
Engagement,  and  many  others. 


Division  Capstone  Exercise  (DCX)  Analysis  and  Results 

Ms.  Lynn  Leath 

TRAC 

255  Sedgwick  Ave. 

Fort  Leavenworth,  KS  66027 
913-684-9115  (fax  913-684-9109) 
leathl@trac.armv.mil 

The  Division  Capstone  Exercise  (DCX)  was  a  two-phased  capstone  event  (not  a  test,  experiment,  certification,  or 
pass/fail  event)  to  demonstrate  the  warfighting  capabilities  of  the  Army’s  first  digitized  division  -  the  4th  Infantry  Division 
(Mechanized)  (4ID).  The  Army  conducted  DCX  Phase  I  (DCX  I),  which  engaged  fully  digitized  forces  for  the  first  time  in  a 
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combat  environment,  at  the  National  Training  Center  (NTC)  in  Ft.  Irwin,  CA  1-14  April  2001.  DCX  Phase  II  (DCX  II),  a 
BCTP  warfighter  exercise,  was  conducted  6-10  October  2001  at  Ft.  Hood,  TX  and  surrounding  areas. 

DCX  represents  an  important  milestone  in  the  Army’s  transformation.  Beginning  in  1994  under  the  spiral  development 
process,  the  Army  launched  a  series  of  AWEs  involving  4ID,  culminating  with  the  DAWE  in  1997,  to  incorporate  and 
evaluate  a  range  of  improvements  in  organization,  doctrine,  combat  platforms,  and  information  systems.  Upon  completion  of 
the  DAWE,  the  Chief  of  Staff  of  the  Army  (CSA)  mandated  that  a  proof-of-concept  demonstration  be  conducted  in  the  2001 
timeframe  to  affirm  the  progress  of  the  key  enhancement  to  the  division,  the  operational  and  field  components  of  the  Army 
Battle  Command  System  (ABCS).  As  such,  TRADOC  established  the  DCX  in  1998  to  serve  as  the  capstone  event  for  4ID  in 
2001,  with  the  goal  to  bring  4ID  to  a  go-to-war  status  employing  advanced  capabilities.  Additionally,  the  DCX  provided  the 
opportunity  to  glean  insights  that  will  help  mature  DTLOMS  requirements,  inform  force  structure  and  digital  architecture 
decisions  for  the  Army’s  future  digitized  units,  and  support  the  Army’s  effort  in  developing  the  future  Objective  Force. 

The  DCX  analysis  effort  utilized  both  quantitative  and  qualitative  techniques  for  evaluating  the  study  issues  and 
addressing  the  demonstration  objectives  for  DCX.  This  report/briefing  identifies  the  analysis  approach  undertaken,  lessons 
learned  from  this  process,  and  key  results  from  the  DCX  analysis. 

The  Use  Of  Design  Of  Experiment  During  Tactics  Development 

Bran  McAllister 

Sverdrup  Technology,  Inc 

Director,  Developmental  Test  Support  Department 
Eglin  AFB,  FL 

850-729-6102  (fax  850-729-),  branford.mcallister@eglin.af.mil 

The  events  of  1 1  September  will  profoundly  affect  military  affairs,  at  every  level  from  strategic  to  operational  to  tactical. 
The  fact  is,  all  activities  in  a  healthy  military — including  tactics,  doctrine,  weapons  acquisition,  joint  operations,  intelligence, 
and  combat  support — should  be  in  a  constant  state  of  positive  change.  That  is  because  the  factors  that  affect  military  affairs 
are  in  a  constant  state  of  flux.  These  factors  include  changes  in  the  threat’s  tactics  and  weapons,  changes  in  the  arenas  in 
which  we  employ,  and  the  emergence  of  new  technologies  creating  potentially  new  capabilities  in  our  weaponry.  History,  in 
fact,  has  shown  that  a  failure  to  accommodate  changes  in  the  threat,  the  environment,  and  new  technology  leads  to  disastrous 
results  in  combat. 

The  emergence  of  a  new  level  of  international  terrorism,  especially  as  a  direct  and  significant  threat  to  the  security  of  the 
continental  US,  is  a  perfect  illustration  of  a  factor  that  will  demand  changes  in  military  tactics,  doctrine,  and  weaponry.  We 
should  expect  to  see,  therefore,  changes  in  strategy,  operational  doctrine,  tactics,  and  weapons  over  the  near  future.  We  may 
also  see  an  increase  in  the  funding  for  these  endeavors.  However,  we  can  be  sure  that  in  any  case,  resources  for  testing  will 
always  be  constrained.  There  will  always  be  a  need  for  efficient  as  well  as  effective  testing. 

All  of  the  services  have  well  established  processes  in  place  to  develop  new  tactics  in  response  to  changes  in  the  threat, 
the  arena,  and  the  available  technology.  In  the  Air  Force,  this  process  is  most  obvious  during  Tactics  Development  and 
Evaluations,  or  TD&Es.  This  form  of  operational  testing  typically  involves  operationally  representative  US  platforms, 
employed  by  combat  qualified  crews,  in  realistic  exercises,  against  representative  live  threats,  capitalizing  on  digital 
computation  for  range  support  and  weapon  simulations.  In  fact,  these  exercises  are  run  as  close  to  combat  realism  as 
possible.  For  air-to-surface  tactics,  live  ordnance  is  often  employed.  For  air-to-air  tactics,  computer  simulations  substitute 
for  live  missiles  and  guns.  Various  tactics  are  proposed  and  then  flown  in  these  realistic  scenarios.  Results  are  collected  in 
the  form  of  both  objective,  quantitative  data  and  subjective  evaluations  from  the  participants.  Because  the  exercises  are  quite 
complex  and  involve  many  players  and  a  large  number  of  variables  (some  controllable,  some  not)  affecting  the  outcome,  and 
because  the  usefulness  of  tactics  is  often  more  opinion  than  fact,  we  have  typically  relied  heavily  upon  the  subjective  post¬ 
mission  assessments  of  the  participants,  and  less  on  objective,  quantitative  analysis. 

The  use  of  Design  of  Experiment  (DOE)  as  a  methodology  for  setting  up  tests  and  evaluating  the  results  has  been 
essentially  non-existent  within  Air  Force  tactics  development.  Even  when  offered  to  test  managers,  arguments  against  the 
use  of  DOE  are  many:  DOE  will  overly  constrain  the  participants  in  realistic,  operational  testing;  the  scenarios  are  overly 
complex  for  DOE;  tactics  are  not  suitable  for  numerical  analysis;  DOE  demands  too  many  resources.  Recently,  there  has 
been  a  movement  within  the  Air  Force  to  utilize  DOE  during  operational  testing,  though  significant  resistance  remains. 

The  truth  is,  DOE  has  been  used  for  many  years  on  very  complex  experiments  in  the  civilian  sector.  Its  application  to 
military  experiments,  including  TD&Es,  is  clearly  apparent.  In  fact,  it  is  during  the  most  complex  kinds  of  experimentation, 
like  tactics  development,  where  DOE  has  the  greatest  potential  to  deliver  more  and  better  knowledge  about  the  phenomena 
occurring,  to  provide  quality  answers  using  fewer  resources,  or  to  yield  more  information  for  the  same  resources. 
Nevertheless,  we  still  face  the  same  arguments. 

The  purpose  of  this  study  was  to  demonstrate  the  utility  of  DOE  in  the  tactics  development  arena  in  order  to  dispel  the 
myths  that  DOE  is  either  impractical  or  ineffective.  The  study  included  both  experimental  design  (for  example,  the  use  of 
factorial  experiments,  randomization,  independent  trials)  and  analysis  (the  use  of  ANOVA).  The  study  utilized  a  Microsoft 
Excel-based  simulation  of  aerial  combat — a  relatively  simple,  but  nevertheless  high  fidelity  model  of  aerial  combat 
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engagements  involving  as  many  as  8  versus  8  players,  using  notional  but  realistic  event  probabilities  obtained  from  subject 
matter  experts.  The  model  includes  such  events  as  threat  detection,  hostile  declaration,  and  effective  missile  employment. 
After  a  significant  amount  of  verification  using  subject  matter  expertise,  the  model  was  given  favorable  reviews.  We  then  set 
up  a  notional  tactics  development  evaluation,  with  a  number  of  control  factors  typical  of  TD&Es  (threat  electronic  warfare, 
friendly  support  assets,  threat  tactics  options,  and  friendly  rules  of  engagement)  to  assess  two  notional  friendly  tactics 
(Option  A  and  Option  B).  Our  response  variables  included  such  typical  air-to-air  success  measures  as  kill  ratios,  threats 
killed,  and  friendlies  lost. 

The  study  used  a  series  of  engagement  simulations  to  compare  the  results  obtained  using  sound  DOE  principles  against 
the  most  typical  methodologies  currently  used:  “one-factor-at-a-time”  and  “best  guess.”  The  study  demonstrated  the 
shortcomings  of  these  techniques  in  comparison  with  both  the  efficiency  and  the  effectiveness  of  results  obtained  through 
DOE. 

By  using  an  inexpensive,  simple,  but  high  fidelity  simulation  of  aerial  combat,  we  were  able  to  demonstrate  the  value  of 
DOE  in  the  complex  arena  of  tactics  development.  The  fact  is  that  in  any  tactics  exercise,  there  are  always  constraints  placed 
on  the  participants,  generally  in  the  control  factors  that  we  chose  for  our  model  (rules  of  engagement,  friendly  support,  threat 
tactics,  and  so  on).  We  have  demonstrated  that  is  possible  to  control  the  engagements  at  the  scenario  level,  without 
constraining  the  maneuvering  and  tactical  decisions  of  the  participants.  Using  the  scenario-level  elements  as  our  control 
factors,  and  by  assessing  results  using  traditional  measures  of  effectiveness,  we  were  able  to  demonstrate  the  utility  of  DOE 
in  spite  of  the  complexity  of  the  experiment,  thereby  countering  the  traditional  arguments  against  DOE.  DOE  was  clearly 
able  to  provide  more  and  better  knowledge  about  the  relationships  between  the  control  variables — especially  the  friendly 
tactics  option — and  the  response  variables,  while  using  fewer  trials  that  expend  valuable  test  resources. 

The  result  of  this  study  is  a  method  of  demonstrating  the  utility  of  DOE  during  the  most  complex  of  tests,  as  the  Air 
Force  embarks  on  a  program  to  make  it  the  methodology  of  choice  for  all  Air  Force  testing. 


Experimentation  within  the  C2  Operation  Centers  -  The  Design  of  a  Quick-Draw  Time  Critical 
Targeting  Team 


Capt.  Edward  P.  McCormick 
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DSN  240-1911 
COMM  210  536-1911 
FAX  210  536-6461 
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Twenty-first  century  warfare  has  mandated  the  gunfighter  approach  to  finding  and  shooting  targets.  This  means  finding, 
fixing,  tracking,  targeting,  engaging  and  assessing  quickly,  before  the  window  of  opportunity  passes  and  the  speed  of 
decision  assures  the  target  no  room  for  shelter.  In  JEFX  2000  we  saw  this  mechanism  paint  a  coherent  picture  of  the 
battlespace  and  formulate  C2  responses  in  a  distributed  environment.  Based  upon  that  picture  we  constructed  a 
representative  team,  one-fifth  the  original  size  with  detailed  descriptions  of  missions,  tasks,  and  informational  flows.  This 
structure  will  be  required  to  manage  larger  and  larger  quantities  of  battlespace  information  but  will  do  it  more  quickly  in 
situations  where  individuals  and  teams  can  work  out  their  battle  rhythms.  This  will  happen  first  in  a  laboratory- like 
environment  which  can  train,  test,  assess  and  improve  performance  at  both  the  individual  and  team  level.  This  presentation 
will  describe  the  assessment  approach  and  methodology  employed  by  the  Air  Force  Research  Laboratory’s  Warfighter 
Training  Research  Division  (AFRL/HEA)  researchers  as  they  observed  the  C2  operators  in  the  Time  Critical  Targeting  Cell 
(TCTC)  during  JEFX  2000.  The  AFRL/HEA  researchers  followed  a  human-factors  oriented  approach  to  gain  insight  into  the 
scope  of  issues  confronting  personnel  in  modern  Air  Operation  Centers.  These  insights  will  ultimately  drive  the  C2  operator 
training  requirements  and  help  characterize  the  individual  and  team  “desired”  performance  capabilities. 

Wireless  Peer-to-Peer  Limited  Objective  Experiment  (WP2P  LOE) 

Prof.  Steven  E.  Pilnick.  Ph  D. 

Naval  Postgraduate  School 
Institute  for  Joint  Warfare  Analysis  & 

Department  of  Operations  Research 
831-656-2283  (fax  831-656-2595 
spilnick@nps.navv.mil 


Peer-to-Peer  (P2P)  collaboration  technology  is  generating  a  lot  in  interest  within  DoD  as  a  new  paradigm  for  Command 
and  Control.  Advocates  assert  that  P2P  offers  several  apparent  advantages  over  classical  client-server  collaboration  that 
historically  supports  traditional  hierarchical  C2.  This  presentation  will  report  on  a  Limited  Objective  Experiment  (LOE) 
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conducted  by  the  Joint  Futures  Laboratory  at  Joint  Forces  Command  Joint  Experimentation  Directorate  and  the  Naval 
Postgraduate  School  centered  around  the  use  of  P2P  applications  running  on  hand-held  and  portable  devices  in  a  wireless 
network  environment.  We  will  highlight  the  issues  of  experiment  design  for  the  LOE  and  how  the  design  flows  from 
planning  through  to  the  results.  In  particular,  we  will  describe  the  breakdown  of  the  experimental  objectives  into  pass/fail 
technology  demonstration  pieces  and  measurement/analysis  pieces.  The  measurement/analysis  pieces  of  the  LOE  include 
technical  network  operations,  systems  vulnerability  analysis  and  cognitive  measurements  of  situational  awareness.  Results 
will  be  presented. 

Authors:  Dr.  Steven  E.  Pilnick,  Naval  Postgraduate  School,  Keith  Curtis,  Joint  Forces  Command,  Dr.  F.  Russell 
Richards,  Joint  Forces  Command,  Dr.  William  Kemple,  Naval  Postgraduate  School,  Dr.  Alex  Bordetsky,  Naval  Postgraduate 
School,  Dr.  Rex  Buddenberg,  Naval  Postgraduate  School,  Dr.  Susan  Hutchins,  Naval  Postgraduate  School,  CAPT  Jeff  Kline, 
USN,  Naval  Postgraduate  School,  Ron  Adamo,  Joint  Forces  Command,  Dr.  Dan  Boger,  Naval  Postgraduate  School. 

Joint  Concept  Development  and  Experimentation  Project  Alpha 

Dr.  Russ  Richards 

U.S.  Joint  Forces  Command,  Joint  Experimentation,  J9 
1562  Mitscher  Avenue,  Suite  200,  Norfolk,  VA  23551-2488 
757-836-2211  (fax  757-836-2885),  richardsn@ie.ifcom.mil 

Project  Alpha  is  a  new  yet  parallel  approach  to  joint  concept  development.  Project  Alpha  is  intended  to  be  a  good  idea 
transfer  agent.  The  goal  is  to  bring  in  good  ideas  that  have  potential  for  revolutionary  changes  in  DoD,  and  also  evolutionary 
changes  and  enhancements  to  the  current  force.  The  difference  in  this  new  approach  is  that  the  focus  is  not  only  on  inserting 
new  ideas  into  the  ongoing  concept  development  process  but  to  streamline  the  development  of  new  ideas  and  get  them  out  to 
potential  stakeholders  for  development  within  their  areas  of  expertise.  Ideas  will  undergo  a  “rapid  analysis  process”  and  the 
product  will  be  a  streamlined  way  of  getting  the  word  out  augmenting  the  formal  DOTMLPF  recommendations  package. 


Future  Combat  Systems  (FCS) 

Gary  Sauer 

DARPA 

3701  N.  Fairfax  Dr 
Alexandria,  VA  22203 
703-696-7493 
(fax  703-696-9781) 
gsauer@darpa.mil 


Command  and  Control  (C2) 

Don  Timian 

Northrop  Grumman  Information 
Technologies 

7900  Sudley  Road,  Suite  206 
Manassas,  VA  20109 
703-331-0906  (fax  703-361-7642) 
dtimian@northropgrumman.com 


David  C.  Brown 

Northrop  Grumman  Information 

Technologies 

5205  Leesburg  Pike,  Suite  1200 
Falls  Church,  V A  22041 
703-824-4020  (fax  703-379-8205) 
dbrown2@northropgrumman.com 


As  described  in  the  Training  and  Doctrine  Command’s  (TRADOC’s)  draft  24  January  2001  ‘The  Objective  Force 
Maneuver  Unit  of  Action”  Operations  and  Organization  Plan,  the  elements  that  describe  combat  power  are  changing.  Today 
combat  power  is  defined  as  a  linear  function:  the  sum  of  maneuver,  firepower,  and  protection  multiplied  by  leadership.  In 
the  Future  Combat  Systems  (FCS)  equipped  force,  combat  power  becomes  an  exponential  equation  where  the  factors  of 
maneuver,  firepower,  protection,  and  leadership  are  raised  by  the  power  of  information. 

This  paper  will  describe  the  joint  Defense  Advanced  Research  Project  Agency  (DARPA)  and  U.S.  Army 
Communication-Electronics  Command  (CECOM)  Research  and  Development  Center  (RDEC)  FCS  C2  program,  as  well  as 
the  overall  experimentation  plan  and  the  FSC  C2  federation. 


An  Integrated  Tool  Suite  for  the  Implementation  of  Computer-Based  Experimentation  in  Support  of 
EBO 


Tom  Tanner 

Principal  Member  of  the  Technical  Staff 

ACS-Synetics,  16539  Commerce  Drive,  Suite  10,  King  George,  VA.  22485-5806 
(540)  663-2137,  (540)  663-3050,  ttanner@dv.svnetics 

As  the  state  of  the  practice  of  effects-based  operations  (EBO)  continues  to  mature  at  an  accelerated  pace,  computer-based 
experimentation  will  provide  the  only  viable  means  of  providing  meaningful  answers  to  many  of  the  emerging  questions.  In 
this  context,  experiments  must  account  for  interactions  between  models  representing  an  expanding  collection  of 
phenomenologically  disparate  disciplines.  Empirical  evidence  suggests  that  interdisciplinary  relationships  are  best 
implemented  at  the  lowest  level  of  aggregation  as  practicable.  This  presentation  demonstrates  a  comprehensive,  integrated 
tool  suite  for  experimentation  that  can  be  effectively  applied  to  the  challenges  of  EBO. 
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As  the  lead  for  Army  experimentation,  the  TRADOC  Analysis  Center  has  developed  a  comprehensive  study  plan  and 
supporting  analysis  plans  for  the  Army  component  of  Millennium  Challenge  02,  Army  Transformation  Experiment  02.  This 
presentation  will  present  the  overall  methodology  and  highlights  of  these  analysis  plans  as  well  as  review  how  Army 
experimentation  has  evolved  since  1997  and  how  we  are  applying  lessons  learned  in  MC02.  The  Army  is  in  the  process  of 
accelerating  its  transformation  to  a  capabilities-based  organization  with  the  intent  of  fielding  the  Objective  Force  by  the  end 
of  this  decade.  The  analysis  during  this  experiment  will  inform  senior  leaders  of  the  Army’s  contributions  to  Joint 
Operations  and  provide  valuable  insights  to  the  Army’s  transformation  pathway. 
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